marshalla

I set the battery to low power mode on the website and it didn't do anything and now I'm profoundly disappointed.

On a more serious note, I think on-device object/face recognition search is a great idea. Having the cta button on the site go to Polar is a little unexpected. It'd be nice to be able to try the app without going through the hoops of running it in a Docker container, if that's the same app or system?

I'm kind of proud of how popular this thread became, even though some parts collected some downvotes.

Key takeaways: People don't like subscriptions for on-device apps, and people really don't like telemetry.

Oh neat, I hadn't even seen or tested SpeexDSP. Pretty happy with localVQE 1.2, it's a little extra on the CPU, but the cancellation is pretty complete.

This one looks super nice. Trying it now. I've got one I'm working on full-time and trying to get people to pay for, and in some ways this beats it. I'm using localVQE for echo cancellation. I really just need to give up and get some corporate job

Ouch. A subscriber cancelled with a P.S. saying the real-time transcription left something to be desired and that I should use GPU models with more accuracy.

Long story short: I got a batching model to behave more like a streaming model, ~2s updates, and it runs on the ANE so it’s efficient annnd it’s more accurate than all feasible alternatives annnd it only took me like a month. Annnd this is a meeting transcription / notetaker app for macOS.

I used a bot to help me generate precise language around the numbers for this post. Forgive me.

Transcription can happen from audio on the system channel without a bot in the call, so if the remote user can hear it, a model can convert it to text.

The noises confuse the ASR models, I presume.

Someone could still record audio and manually transcribe it or take notes with a pen and pencil... just sayin'. Some of this just comes down to having to trust the other party.

I do take some issue with my voice almost certainly being used to train models when using certain services.

My prediction is that soon every mid-size+ company will have their own hardware running an open-weight model and all employees will be required to connect to it and it alone for inference.

Nice, how well does WhisperKit work for diarization?

lol fair that's very dev of you. The next gen of models will prob one shot my app anyway.

I like the idea of having a completely headless auto recording system. I was against it initially over privacy concerns but with completely on-device its a better idea. I might snag the concept