Show HN: Parakeetogo, a portable ASR binary faster than Photon/torch for CPU

I wanted an easily deployable way of bringing transcription to an underpowered server I have. I used Moondream's excellent parakeet-redux as a base model and adapted Highway SIMD to run it. The result is a single binary with the model embedded than can provide nearly identical transcription quality while running even faster than the Photon/torch model on CPU targets. Benchmarks are in the repository.
2 points robviren 28 days ago 0 comments

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton