When I was in Tokyo a bartender chatted with me for a while using a hand held stand-alone device that did voice (audio without relying on text) two way near-real-time translation.

It worked really well and I was confused I have never seen one before.