cataflutter

This is going to be very geographically dependent, surely?

Some of the inference engines can process multiple requests in parallel more efficiently than doing them sequentially. Not sure of the exact mechanism but e.g. llama.cpp's llama-server can do this (you tell it the number of slots to have when starting, then fire HTTP requests at it and it batches them together when it can).

Waiting for the hooman (or tool calls) won't help either, of course.

They have a presence in London; have met someone who works there. Sounds like there is an office too

Disk space is one thing, but the actual download size is higher than some people's data allowances altogether! It baffles me that a lot of people don't seem to be aware of this

Disagreed; it's not a download you'd expect and it's also at least an order or two of magnitude than you'd expect to find reasonable for browsing a page.

I have a 2GB mobile data plan. If I was using Chrome, then some site triggers the Prompt API, that will cause Chrome to not only wipe out my data plan, but need 2 of my data plans. I don't find this reasonable.

This is exactly a consent problem, because I'm not denying it might be a useful feature, but it should be at the user's own informed choice. The fact that Chrome developers don't appear to see this might be due to them living in a bubble where they've never had to think about the costs.

Probably explains it, but one wonders why this page would need WebGL at all. It's not like it's a rich graphical application... is it? :)

> the function signature is what they read, but the scars are what they need.

This feels like a golden quote. Don't know if you intended for it to rhyme, but well done :D

A while ago I checked this out and the homepage looked like it had fallen to the 'AI hype' trend, you know like how everything was 'AI-native XYZ for Autonomous Agents' at the time. I'm not seeing that now though.

Am I thinking of someone else or did you reverse on that?

they don't restrict you to using their opencode agent, you can use go in any other agent

Weird; I clicked through out of curiosity and didn't get any corruption of the sort in the end result.

I also asked it some technical details about how diffusion LLMs could work and it provided grammatically-correct plausible answers in a very short time (I don't know the tech to say if it's correct or not).

that said the documentation is rough, especially for their support for non-React frameworks

Do you have anywhere for people to follow the developments? :)

Do you have anywhere people can follow out of interest? :)

This looks really excellent, looking forward to giving it a try, thank you for sharing!