These AR Glasses Can Translate Languages and Detect Images

New ‘Frame’ AR glasses from Brilliant Labs uses artificial intelligence.

Image credits: Brilliant Labs

The Frame AI glasses from Brilliant Labs use augmented reality and artificial intelligence to translate languages, recognize photographs, search the internet for information, and more. The wearable gadget resembles a pair of smart glasses with built-in artificial intelligence. In reality, Frame AI eyewear receives coding and technological support from OpenAI, Whisper, and Perplexity to enable them evaluate and notify users about what is going on around them. The AI glasses display the information directly in front of the user's eyes in the Brilliant Labs movie.

They show users the type of building they are looking at, how to translate words they see into the language they understand, and where to locate and purchase the sneakers they have seen online or in the streets. By including an additional pair of lenses in its monocle—dubbed the world's tiniest augmented reality device that attaches to glasses—Brilliant Labs has upped the ante. Users only need to wear the Frame AI glasses to experience augmented reality in both eyes; they do not need to clip anything.

A New Type of AI Assistant

Noa, a new type of AI assistant that Frame has installed, is an always-on AI assistant that resembles Jarvis from the "Iron Man" television series. The company claims that Frame redefines how we interact with physical environments and alters how we see the world. Tavangar claims that because Noa gives people more ability to interact with their surroundings, it is a novel sort of AI virtual assistant.

Noa supposedly becomes a distinct personality through adjusting to the user's interactions. Beyond just translating material into other languages and summarizing pages, the virtual assistant can do more. The gadget can control several AI systems to do complex tasks thanks to its built-in multimodal generative AI.

The integrated multimodal generative AI system that powers the AI glasses can run the GPT-4, Stability AI, and Whisper AI models simultaneously. Noa is now working on unique picture production, real-time speech detection and translation, and real-world visual processing. The startup claims that because of Frame's multimodality, many AI models may work together to provide almost endless possibilities in daily life.

Sam Draper
February 15, 2024

Innovation of the Month

Do you want to discover more, visit the website
Visit Website

Other news

EU Project Smart2Go Aims to Create a New Generation of Wearables that Never Need Charging

Charging your smartwatch can be a headache. With...

Wearables Startup KaHa Raises $6.2 Million in Series B Funding

KaHa has raised $6.2 million in a Series B funding to accelerate its growth in Asia.

Solar Panels in Your Eyeballs to Restore Vision

Scientists are working on implanting small solar panels inside people's eyes to restore vision.

Signia Active Pro: Stylish Earbuds That Are Actually Hearing Aids

Age-related hearing loss is an increasingly important public health problem affecting ...
Discover more