Microsoft has begun limited testing of Copilot Vision, a cutting-edge AI feature integrated into its Edge browser. Introduced through the experimental Copilot Labs platform, this tool aims to enhance how users interact with web content by allowing the AI assistant to “see” the text and images on a webpage you’re viewing. Whether you’re exploring product reviews or deciphering a handwritten recipe, Copilot Vision can assist by answering questions, providing recommendations, or even suggesting the next steps—all while keeping the experience streamlined within a single browser window.

How it works

Once enabled, Copilot Vision scans the active webpage in your Edge browser and provides context-aware support. For example, it can help compare products when shopping online or recommend recipe tweaks based on available ingredients. It operates under strict opt-in conditions, meaning it only activates with explicit user permission and for pre-approved websites. A visible browser hue indicates when the feature is active, ensuring transparency.

In light of privacy concerns, Microsoft has built strong safeguards into Copilot Vision. The AI doesn’t store, share, or use any personal inputs, and all data is erased when a session ends. It also respects copyright and privacy protections by avoiding interaction with paywalled or sensitive content. Moreover, while user inputs aren’t logged, the model responses are retained temporarily to monitor potential misuse and improve functionality.

Availability

For now, Copilot Vision is accessible to a small group of U.S.-based Copilot Pro subscribers under the Copilot Labs program. Microsoft plans to expand its reach cautiously, gathering feedback to refine the experience further. It’s part of a broader push to responsibly introduce transformative AI technologies to everyday tasks while addressing ethical challenges head-on.

This feature could redefine browsing by merging AI’s assistance capabilities with web navigation, making it a potential game-changer for productivity and online experiences.