For example, through Google Lens, a needle that doesn’t fit into an old record player was shown to Gemini, and it was asked why the needle wouldn’t fit. The assistant then identified the make and model and provided a step-by-step explanation of how to resolve the issue.
And you’ll also be able to ask questions with video, right in Search. Coming soon. #GoogleIO pic.twitter.com/zFVu8yOWI1
— Google (@Google) May 14, 2024
Google states that its search engine is now more than just words typed into a text box. The company claims that you can search with any object, whether it’s in motion or not, saving people from wasting time typing.
Gemini’s capabilities are not limited to this. On Android, Gemini can already summarize or answer questions about a web page or a screenshot. Soon, the assistant will be able to detect if there is a video on your screen, and you will be able to ask questions about that video. Gemini will answer your questions about the video by using its automatic captions to find the answers.
Yesterday, OpenAI introduced ChatGPT 4o, which has the ability to comment on live video in real-time, identify scenes, and even sing a song about them. However, Google is currently focusing on search rather than video. The company stated that video search will initially be available to Search Labs US users in English, but will expand to more regions over time.
Page Contents
Toggle