sipjca

I mean artificial is in their name....

I understand. And inference optimizations are great. It's just that it's not a new model, and that's what I was excited about. I work on cross-platform transcription inference and was hoping for something more than just a re-badged parakeet v3

Look forward to the next model

seems to be…

at first i got very excited about a new fast transcription model (voz) but turns out its just parakeet v3 with some new inference code which is macOS/iOS specific

it's unbelievable this was not pointed out earlier in this thread, long live tom 7

what do you mean cheaper/faster is not really coming? the cost of the same level of intelligence steadily decreases year over year. computer hardware also advances at the same time enabling cheaper and faster serving (or move to local)

people are lazy

people don't want to maintain infra (ie adding new models all the time)

people want their queries to work without thinking

if a provider goes down, openrouter queries dont (ideally)

it's really not that complex to understand

Agree, I was not talking about a business context.

But if people are submitting garbage in a business context you got other problems you need to address.

As a maintainer just saying no and closing PRs is largely the solution

Unfortunately you are wrong. Time marches on and progress in silicon does too. You may not like the timeline, but it will happen.

While not exactly an “SSD”, High Bandwidth Flash will make it to market and make big sparse MOE models even more accessible. Everyone knows bandwidth is the game right now and you think hardware vendors are going to sit on their heels and not take part of the market? Absolutely silly to discount progress both on the software and hardware sides.

all day yesterday, Taiwan time Sol was having significant issues.

“Overloaded”, maybe half of requests or more wouldn’t go through

It's not that much extra work to compile, the extra work comes from the maintenance and feature requests. By not shipping the binary directly I am defending my time until other contributors want to step up and maintain things. I am one person with limited time and I don't want to spend all of it in front of a computer

Yes you use them through a wheel. If you have specific questions on packaging and how to use things lets move it over to the discussions/issues in the repo itself so it can be more broadly accessible to more people and we can make the packaging of the library as useful as possible

we have wtype and ydotool support as well in Handy, but it's not exactly a great out of the box experience always, but some of it is on me for poor linux packaging

Right now I intend to maintain this as a library. The examples are just that, examples for programmers/agents. If someone in the community wants to step up to maintaining release binaries I will gladly have that support, it's just impossible to do as a sole maintainer