A groundbreaking AI headphone system, Spatial Speech Translation, can translate the speech of multiple speakers simultaneously in real time. The system tracks the direction and vocal characteristics of each speaker, allowing the headphone wearer to identify who is saying what. It works with existing noise-canceling headphones connected to a laptop with an Apple M2 chip. The system was tested on French, German, and Spanish, translating them into English. It achieves near-perfect translation for these languages, which have ample training data. The AI model divides the space around the wearer into regions to locate speakers and then translates their words while cloning their voice characteristics. The system’s latency is being improved to enhance conversational flow, with the goal of reducing it to less than a second. Currently, French to English translation is the quickest, followed by Spanish and German.
Artificial Empire
@artemp_official
·
19h Researchers in the United States have developed an advanced headphone system that translates several speakers at once, while preserving the direction and qualities of people’s voices.
Developed by University of Washington researchers, the system is called Spatial Speech
Kohei Kurihara – Privacy for all together
@kuriharan
·
17h Learn out. AI-powered headphones offer group translation with voice cloning and 3D spatial audio https://techxplore.com/news/2025-05-ai-powered-headphones-group-voice.html… via
@techxplore_com
#tech #digital #data #privacy
Owen Gregorian
@OwenGregorian
·
May 10 A new AI translation system for headphones clones multiple voices simultaneously | Rhiannon Williams, MIT Technology Review
Spatial Speech Translation addresses one of automatic translation’s biggest challenges: lots of people speaking at the same time.
Imagine going for dinner
Sam Konneh
@sam_konneh
·
May 9 AI Earbuds Translate and Clone Voices in Real Time
AI earbuds now break down language barriers in 144 languages while eerily cloning your voice in real-time. These smart devices redefine global communication.
https://designcopy.net/ai-earbuds-translate…
Brian Ahier
@ahier
·
23h A new AI translation system for headphones clones multiple voices simultaneously
https://technologyreview.com/2025/05/09/1116215/a-new-ai-translation-system-for-headphones-clones-multiple-voices-simultaneously/…
To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions.
Functional
Always active
The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
Preferences
The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
Statistics
The technical storage or access that is used exclusively for statistical purposes.The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
Marketing
The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.
