Google is taking a significant leap forward with its visual search tool, Google Lens, by introducing a feature that allows users to search the web using video. This enhancement, announced at the recent I/O developer conference, marks a departure from Lens’s previous capability of only capturing still images. Now, users can leverage both video and audio to pose their queries, adding a dynamic new dimension to the search experience.

The practical applications of this feature are broad and intuitive. Imagine facing an issue with your car and needing expert advice on the go. Instead of typing out a description or snapping a photo, you can simply shoot a video, point your camera at the problematic area, and narrate your concern. This multimodal input method—combining visual and auditory data—enables Google to process and understand your query more comprehensively.

Video search through Google Lens represents a substantial leap in the integration of artificial intelligence into everyday tools. This capability is designed to simplify how users interact with search technology. For instance, with a video, Google can capture more context than a still image ever could. If your car makes a strange noise or a part dangling, you can record it, ask “why is this thing hanging off the bottom,” and Google will use visual and audio clues to provide a more accurate response.

Liz Reid, Google’s head of search, explains that the primary aim is to streamline the path from question to answer. She highlights the advantage of video in capturing motion and complex scenarios that are difficult to describe with static images or text. Take, for example, a malfunctioning dishwasher with specific blinking light patterns. Explaining which lights are blinking and their frequency can be cumbersome. However, with a video, Google can immediately identify the model of your dishwasher, analyze the blinking patterns, and diagnose the issue. This approach eliminates the need for precise keyword input, which can often be a barrier to effective troubleshooting.

This innovation is not just about convenience; it underscores Google’s broader ambition to enhance its AI capabilities. Lens is central to Google’s vision of a more intuitive and responsive search experience. As Reid suggests, the evolution of search is heading towards interactions that feel less mechanical and more conversational, akin to querying a knowledgeable friend.

Incorporating video into search via Google Lens aligns with the ongoing narrative of AI integration into Google’s ecosystem. The company’s relentless pursuit of making search both easier and more compelling is evident in this latest development. By enabling users to articulate their queries through video, Google is making strides in refining the user experience, making it more natural and efficient.