Microsoft has begun rolling out a new feature for Windows 11 Insiders in the Dev Channel: live translation for Intel and AMD-based Copilot Plus PCs. This development marks a significant step in making communication more accessible across linguistic barriers, directly from your desktop or laptop.

The live translation feature, initially introduced on Qualcomm-powered Copilot Plus PCs, has now expanded its reach. It enables real-time translation of audio into English subtitles from more than 44 languages. This functionality is not limited to specific applications but is versatile enough to handle various sources of audio. Whether you’re watching a YouTube video, participating in a live video conference, or listening to a recorded message, the system will provide subtitles in English if the original audio is in one of the supported languages.

Languages currently supported for translation include major ones like Spanish, French, Russian, Chinese, Korean, and Arabic, making this feature particularly useful for global users engaging in multilingual environments. This could be a game-changer for educational purposes, business meetings, or even casual entertainment where language barriers might have previously been prohibitive.

How it works

The process is seamless. When the audio from supported languages is played on a Copilot Plus PC, the system automatically detects and processes this audio, generating English subtitles in real-time. This is all done locally on the device, ensuring privacy and reducing latency, which is crucial for real-time applications like video conferences.

This isn’t the first AI-driven feature Microsoft has introduced for Copilot Plus PCs. The expansion to Intel and AMD hardware signifies Microsoft’s ongoing effort to democratize AI technology across different hardware platforms. Earlier this month, similar AI enhancements, including “Recall“, which captures and lets users revisit specific activities on their PC, were also tested on Intel and AMD devices. These features leverage the power of AI to not only process but also understand user activities, enhancing productivity and user interaction with their devices.

Updates for Qualcomm PCs

Parallel to the expansion for Intel and AMD, Microsoft is also updating the live translation feature for Qualcomm-equipped Copilot Plus PCs. A significant addition here is the ability to translate into Simplified Chinese, expanding the linguistic utility for users in China and those communicating in Chinese worldwide.

Implications for users and developers

For users, these updates mean a more inclusive digital environment where language is less of a barrier. For developers and businesses, it opens up new avenues for application development, particularly in educational software, customer support systems, and international business tools. The real-time aspect of these translations could also prove invaluable in scenarios requiring quick, accurate communication across languages.