Project Astra: Google unveils its new AI capable of reading your screen and automatically translating

earthpressnews
Project Astra Google unveils its new AI capable of reading

Google has just lifted the veil on “Project Astra”, a new research prototype integrated into Gemini and which provides numerous functions designed for your phone and connected glasses.

Always eager to be one of the leaders in the artificial intelligence market, Google has just launched presentations of a new research prototype currently in the testing phase. Called “Astra Project”, this prototype is designed to be used on a smartphone but also connected glasses without specifying the model (future Google glasses?).

The Astra Project presentation video lasts just under five minutes. However, it is not burdened with complicated technical details but presents several uses for the functionalities linked to the project. The Astra Project is based in particular on version 2.0 of Gemini, Google’s artificial intelligence in beta testing for certain users around the world.

Among the functionalities of the Astra Project, we discover in particular:

  • The ability to view your phone screen.
  • Searching for specific information in an email.
  • The concordance between a question on a photo (here, washing instructions) and its application on another photo (here, a washing machine).
  • The description of places and locations based on the activities available on site.
  • Help with pronunciation of words.
  • Obtain information about a work of art or building then initiate a conversation around it.
  • And many other examples such as real-time translation depending on the language spoken in Gemini.

More generally, the Astra Project is designed around three main axes: real-time conversations, storing your conversations and using other Google tools to answer your questions.

This prototype is currently being tested for certain users selected by Google in the United States and the United Kingdom. It should be noted that the Astra Project is available on smartphones, but also on connected glasses called “prototype” on the official website. Would this confirm that Google is indeed working on connected glasses that would compete with the Ray Ban Meta? Only time will tell.

lnte6