Smartphone Camera Control Architecture

Brief

A fast-growing startup wanted to disrupt the smartphone camera market by developing a cost-effective and scalable silicon architecture for controlling actuators in multiple camera modules. The challenges of this project were multifaceted:

  • Cost and Size Constraints: In high-volume consumer electronics, particularly smartphones, reducing both the cost and size of components is an ongoing challenge. The company needed a compact, cost-efficient solution that could still provide the sophisticated control required by their camera actuator systems.
  • Complexity of Existing Solutions: The existing architecture relied on discrete chips to power the actuators, manage inputs from motion sensors, and also run control algorithms. This setup became increasingly complex, especially with products that featured multiple actuators. The use of multiple discrete chips added both cost and complexity to the system.
  • Multiple Camera Modules: The architecture needed to support a multi-camera system, where one or more camera modules could be operated simultaneously. Additionally, the solution had to ensure efficient sharing of key smartphone resources like the onboard motion sensors while maintaining compatibility with the architectures of different smartphone vendors.
  • Multi-Sourcing Challenge: With camera modules sourced from different vendors using different driver ICs, the architecture needed to be flexible and allow seamless integration of these components.

Solution

To address these challenges, we developed an innovative distributed processing solution.

  • Splitting Functionality for Efficiency: Rather than using a single, complex chip for both power delivery and control algorithms, we divided the functionality to reduce cost and complexity:
    • Simplified Driver Chip: We developed a much simpler driver IC focused solely on powering the actuators and handling analogue measurements. By eliminating real-time control algorithms from the chip, this solution reduced both the cost and footprint of the driver IC, resulting in smaller and cheaper camera modules.
    • Offloading Control to the Host Processor: The complex control algorithms were offloaded to the smartphone’s existing Application Processor (AP), which already had sufficient processing power. This strategy reduced the cost, since the AP was already a part of the device’s architecture.
  • Optimizing the Host Environment: Integrating the control algorithms into the AP required careful specification and verification to ensure the software would coexist seamlessly with other time-critical applications. We developed a solution that guaranteed quality of service while managing resource sharing, ensuring key functions such as motion sensing and camera control could work harmoniously.
  • Flexible and Compatible Architecture: To support multi-vendor sourcing and ensure flexibility, we defined the communication bus topology and developed a protocol that allowed the AP to auto-detect and configure actuator driver ICs, regardless of vendor. This was critical in enabling the use of pin-compatible devices from multiple IC vendors, providing the smartphone manufacturer with greater flexibility in sourcing components. This also allowed the architecture to support multiple cameras simultaneously, further increasing the system’s flexibility.

Ready to elevate your development activities? Contact us today to explore how we can accelerate your project’s success.