tlack

Great ideas! Right now live transcription is hampered by the amount of memory available. I'll research whether or not this can be improved.

I wrote the README from the perspective of being understandable by the lay person, and I think I left out some vital clues about this being a software building block for making your own ESP32 projects more intelligent. I pushed a README update to make it 0.1% more clear.

As for what to talk to.. or the ultimate purpose lol.. you could do simple device control scenarios ("lights off"), do hands-free sensor readings ("temperature at 95 degrees"), change wifi settings via voice ("switch access points"), etc.

I use it to control an agent-powered diverse device sensor network in my home and my truck. Much of the capability needs Internet access, but having on-device speech to text and text to speech means I can still do some stuff when I didn't bring the Starlink with me. On-device STT opens up a lot of low bandwidth (lora) opportunities too.

It's a library for C / Micropython / AtomVM, so you could send the result over a lora radio, ESPNOW, WAN, match it in a switch statement to activate a relay, draw on the LCD.. that's up to you.

Many ESP32S3 dev boards have a microphone and speaker header available conveniently on the board, so I have been using that to respond via Babytalk's text to speech capability.

I'll improve the README to make it a little more clear.

It seems like everyone is more worried about how something was made rather than what it is or whether or not the work is good on its own merit. Ironic from a group that is surely using AI tools in their own work.

If your application is pricing sensitive, check out DeepInfra.com - they have a variety of models in the pennies-per-mil range. Not quite as fast as Mercury, Groq or Samba Nova though.

(I have no affiliation with this company aside from being a happy customer the last few years)

Vast.ai is a well known provider in that category.

Runpod also has an offering in this space but I think they’re shifting toward more managed-by-them rental services.

If you want someone to take you up on that offer you gotta specify a % differential from cloud list price. :)

Sounds great to me! Just be sure the AI is capable of taking on various personas because not everyone you meet is a believer in nonviolent communication.

A tip, Miami guy to Miami guy - the best devs eschew PHP like the plague. The remaining PHPers are desperate work-a-day sorts who will not be bringing the latest hotness to your project. Hire an Elixir or Haskell expert and you're gonna get a much more well-traveled coder.

Kudos on your bold undertaking! I've been a side-lined QNX admirer for some time, though not a potential user in most cases. A good next step would be a series of blog posts where the author takes on common types of enthusiast projects and unpacks how QNX's strengths can be applied in those scenarios.