Real-time dubbing of whatever your iPhone is playing
testflight.apple.com
1 thread
I'm Japanese, and most of the tech podcasts I want to hear are only in English. I wanted to just listen, not read subtitles.
So I made an iPhone app that dubs whatever your phone is playing into your language as it plays, in a voice like the speaker's. It works on top of any app.
Launch video: https://x.com/CROON_tv/status/2102377490367046122
The link is a TestFlight beta, and it needs the iOS 27.2 beta for now.
Would you use this?
That's amazing! How do you do the translation? What is the delay? How do you deal with idioms?
Thanks! Translation is done with ASR, an LLM and TTS.
The delay is about 4 seconds on average. It could be faster, but translating half a sentence gets confusing, so it waits for the sentence to end.
The LLM handles idioms.