I have a telegram bot, and I used to have it read message in a group chat to detect the language, and if it wasn't English, it would use gpt5 nano to translate.
To save on inference, I had Claude create a lightweight typescript library to handle translations and detection. Now I get the previous functionality for 200mb~ ram versus paid API credits.
I also built a home assistant menu bar in osx, let's me easily monitor activity, toggle devices, view cameras, etc.
To save on inference, I had Claude create a lightweight typescript library to handle translations and detection. Now I get the previous functionality for 200mb~ ram versus paid API credits.
I also built a home assistant menu bar in osx, let's me easily monitor activity, toggle devices, view cameras, etc.