It's just a concept, but i'm sure it's possible to build something like that with esp32 and eink display. It uses fully local speech to text, for real device i'd use a server based transcription.
it works only on desktop, unfortunately didn't have much patience to make it responsive on mobile
it works only on desktop, unfortunately didn't have much patience to make it responsive on mobile