Show HN: Arda Translate, free private on-device (iOS) translation
apps.apple.comHi C.J. here, I made a free app that does on device translation using Gemma Translate 4B AI model repackaged for iOS. This allows for after model download, private offline translation locally on your iOS device.
I made this app after trying to talk to my neighbor and service not being great at the bus stop where I drop off my daughter. I have tried to make the app UX easy to use and I really like the default view where the translations appear flipped on each side so you can hold the phone in the middle and each person has a side of the phone.
Hope you enjoy and let me know what you think! That's kinda neat. Do you do any decoding tricks to handle varying processing capabilities across device models and ipads? Like shortening ctx length or maybe looking into the LFM models that have MoEs with like 1b active? Right now I am just restricting it to devices with 8GB RAM. I plan to start testing older phones soon to see if I can get it running well on them. MoE with low active params is interesting. I wonder if there is smaller models based on specific pairs (En/Es, ect.) may I ask why you named it Arda? haha