Meta Unveils New Landmark Identification Feature for Ray-Ban Sunglasses
Ray-Ban’s Meta sunglasses have introduced an innovative feature in their latest beta release, allowing users to identify and learn about landmarks through AI-powered visual search capabilities. This feature adds a practical dimension to the sunglasses, serving as a valuable tool for travelers.
Meta’s CTO, Andrew Bosworth, highlighted the functionality of the new feature, describing it as a virtual tour guide for users. The sunglasses can identify landmarks in various locations and provide detailed information about them. For example, users can learn about the reasons behind the Golden Gate Bridge’s orange color, the history of iconic landmarks like the “painted ladies” houses in San Francisco, and more. These descriptions are displayed as text below the images, enhancing the user experience.
Mark Zuckerberg showcased the feature through Instagram videos captured in Montana. In these demonstrations, the sunglasses utilize audio to offer verbal descriptions of landmarks such as Big Sky Mountain and the Roosevelt Arch. Additionally, they provide insights into natural phenomena like snow formation, making complex concepts accessible to users.
The landmark identification feature was initially previewed at Meta’s Connect event last year, as part of the company’s efforts to enhance the “multimodal” capabilities of its smart glasses. These capabilities enable users to receive real-time information and answers to questions based on their surroundings. The feature leverages Meta’s partnership with Bing Search, ensuring access to up-to-date information beyond the previous knowledge cutoff in 2022.
This functionality is integrated into Meta’s existing Google Lens-like feature, allowing users to interact with their environment through the glasses and seek information from the AI assistant. Users can point out objects, texts, or scenes and ask questions, facilitating tasks such as translation of foreign text or identification of unfamiliar fruits. While the feature is currently available to users enrolled in Meta’s early access program, the company aims to expand access to a broader audience in the future.
For those interested in trying out the beta version, Bosworth encourages them to join the waitlist as Meta continues to refine and expand the availability of this innovative feature. With the addition of landmark identification, Ray-Ban’s Meta sunglasses offer enhanced functionality, combining fashion with practical utility for users on the go.
