Apple Integrates AI Camera Capabilities into Siri
Apple's WWDC showcased Siri's new camera analysis mode, enabling it to identify objects, answer questions about visuals, and assist with tasks like bill splitting via Apple Cash. These multimodal AI upgrades, dubbed 'Visual Intelligence,' are rolling out to Apple devices and draw comparisons to Google Lens functionality.
Key points
- Apple announced Siri mode in Camera at WWDC, allowing the assistant to analyze camera views for object identification and information.
- The feature includes answering follow-up questions and assisting with bill splitting using Apple Cash.
- These upgrades are part of Apple's broader AI enhancements for Siri, referred to as 'Visual Intelligence'.
- Functionality is noted to be similar to Google Lens, which introduced receipt scanning and bill splitting features in 2019.
- The visual AI updates will extend to multiple Apple devices beyond the iPhone.
During its Worldwide Developers Conference (WWDC), Apple unveiled significant advancements for its virtual assistant, Siri. A new 'Siri mode in Camera' feature will empower the assistant to analyze real-time camera feeds. Users can direct Siri to identify objects, provide information, and even answer contextual follow-up questions based on what the camera sees.
This new capability, integrated under the umbrella of 'Visual Intelligence,' expands Siri's multimodal AI functions. Apple demonstrated how the feature can recognize items in the camera's view, offer details like nutritional information for food, and facilitate practical tasks such as splitting bills among friends using Apple Cash. These visual analysis upgrades are slated for release across various Apple devices, not exclusively the iPhone.
Industry observers have pointed out similarities between Apple's new camera-centric AI features and existing functionality offered by Google Lens. Google's tool has provided object recognition and processed receipts for bill splitting since 2019. Apple's integration aims to bring comparable intelligence directly into its core assistant, enhancing user interaction with the iPhone camera.
Sources
The WireByte editorial team synthesises technology news from multiple primary sources, verifies the facts, and links every source. Articles are produced with AI assistance and reviewed under our editorial policy.