neilellis

Claude had munchies....

Did you actually try them, I tried a sample they were rubbish compared to Jev - I'm not saying they will survive, but the competition CURRENTLY sucks - and also they aren't actually cheaper if you need them at scale. OpenAI is coming in twice the cost and so is Cloudflare. Ad yes you can finetune, and yes I do, but it also SUCKS. Fine-tuning and managing your own datasets is yet another timesink. So we'll see, but it's not quite black and white.

So they ban us from scraping sites but they can do it themselves, this stinks. How did we let them become the internets gate keeper.

The Onion isn't satire it's just a dystopian Cassandara.

Well now all the agents will have this in their training data, so expect them to come calling in the future :-) :-)

Peak HN comment :-)

Easy for you to say.

I like it, very smart for agents at scale.

'frontier models' - seriously, it was you and only you!

Good luck with this model/product, in the excitement of LLMs people seem to forget applicability. I very much like to see innovation in this space, so well done!

Also FYI doesn't run inference on Apple GPU (only for training)

I tried this today for labelling - and for that task it was very bad MNLI was better - so you are going to need to match the use case for this pretty exactly. (at 29MB params one would expect that!) I'm obviously not saying labelling is a good use case :-) just adding a data point.

Jev has put the cat amongst the pigeons so suddenly everyone is looking at classifiers and encoder only models again.

My ideal model would be a general purpose LLM API that can answer classification questions and as it does so distils to an encoder only model so that the more classifications I do the cheaper it gets (i.e. the more it offloads to the classifier). If anyone ever wants to do this as a service do let me know, because it's just another piece of code to manage in each new project that needs classification.

Also a model that could do this internally would be nice :-)

Please have a 'readable version' option so I don't have to exhaust myself parsing the sites layout. I get that it's unique but most of us just want to work out what you're offering in 5-10 seconds of our time.

OMG blast from the past!