Discover the groundbreaking new feature from Microsoft that allows Windows users to translate and add subtitles to videos in real time using advanced AI technology.
Introducing Real-Time Video Translation and Subtitling
The tech giant has unveiled a cutting-edge feature for Windows 11 that offers real-time subtitles and translations for your videos. Utilizing the power of AI from Copilot, this innovative tool can instantly translate any video content. Whether you’re on a video call or watching saved videos on your hard drive, this technology can enhance your experience.
Availability on Windows 11
The live captioning and real-time translation feature is now available on Windows 11. This capability is accessible if you have a Copilot+ PC with an Intel, AMD, or Snapdragon processor. It supports translation across 44 languages, including Spanish, bridging communication gaps between people who speak different languages.
The Evolution of Real-Time Translation
Real-time translation has been a focus area for tech companies for years. Significant advancements have been made in services such as Google Translator and Skype. However, the introduction of AI has accelerated these developments. Recent experiments with technologies like Google Glass and Copilot demonstrate how subtitles can be added to speakers in real time.
“We are beginning to roll out the ability to translate more than 44 languages into English in live captions, including speakers in real-time video calls, recordings, and streamed content,” said Microsoft in a blog post on Windows.
Language Support Expansions
Currently available only on English-speaking PCs during its testing phase, the launch will eventually include support for Spanish. For Copilot+ PCs with Snapdragon processors, Windows will offer real-time translations into Chinese while also supporting English, Spanish, German, French, Italian, and other languages.
How It Works
According to Microsoft’s support documentation, live captions offer translations by converting any audio passing through the PC into text in your preferred language. The processing occurs entirely on the device using the AI coprocessor found in Copilot+ PCs; data is never uploaded or shared externally.
Activating Live Captions
- Click the battery, network, or volume icon on the taskbar to open quick settings and enable Live Captions.
- Use the keyboard shortcut Win + Ctrl + L.
- Toggle Live Captions from the Accessibility quick settings floating control.
- Select Start > All Apps > Accessibility > Live Captions.
- Navigate to Settings > Accessibility > Subtitles and toggle Live Captions on.
This feature is currently available via Windows 11 Insider in the development channel. If subscribed to the program, simply download and install build 26120.2705 (KB5050636).