Google Introduces Camera Access for Gemini AI: Key Features and Benefits
Last Updated:
Google AI Expands with Powerful New Features: Gemini Uses Your Phone’s Camera
Google’s Project Astra AI assistant will work through the Gemini Live feature
While some companies struggle to improve their AI, Google is enhancing its Gemini AI capabilities. Recently showcased at the I/O 2024 event, Gemini’s new powers are all integrated into a single app for smartphone users.
The Astra feature, part of this upgrade, enables Gemini to utilize your phone’s camera to “see” and interpret the surrounding environment. This innovative approach is being rolled out to all Gemini users, and early feedback from Android users has been positive.
How Gemini AI Utilizes Your Phone’s Camera
Google leverages the camera on your smartphone to empower the AI assistant to better assist you with real-world tasks. For example, it can read code written on your computer screen, helping you understand or troubleshoot complex programming issues.
You can also aim your camera at your surroundings, asking the AI for your exact location or additional local information. The feature known as “Share-screen with live” allows Gemini Live to showcase these innovative abilities, but it is currently available only on select Pixel devices.
While there are privacy concerns that come with this level of functionality, Google claims they are taking steps to ensure user safety and trust, although more safeguards will be needed as technology advances.
OpenAI offers a similar feature with its ChatGPT 4o version, but Google’s Gemini AI will be more widely accessible and largely free, with some advanced features requiring a subscription to the Google One AI Premium plan, priced at about ₹1,950 per month. However, specific Pixel models may include this service at no additional cost.
Project Astra is expected to be rolled out to consumers by March 2025, meeting the company’s timeline. This AI feature could complement other devices like smart glasses, which Google initially explored years ago. Sergey Brin, a co-founder of Google, has referred to AI as “the perfect hardware” for wearables, indicating the potential for future innovations in this space.
