74948494i4

This is good timing. My setup at home involves a two servers with 5080s each and an Rtx spark laptop with 128gb. I plan I have qwen flash next on the latter and the 27b variant on the former. I would’ve preferred to have purchased a dgx spark but everything is just ridiculously expensive now. My own setup would be 3x the cost to buy again.

I’m mainly trying to replicate Gemini flash and muse agent for my family of 4 without breaking the bank (already had a 5080 for gaming and the other for image gen).

It is unclear if this memdoor works for agentic tasks, e.g.: “check daily if dune 3 tickets are for sale and if they are buy tickets for 4 where all 4 seats are next to each other in the same row and as center as possible.”

There is a huge cliff once you go past 128gb. Basically you need either Rtx 6000 pros (20k+) or a cluster of dgx sparks (15k+)

That pretty obviously fails the copyright test. Training on text/pictures/audio isn't transformative because you are producing...text/pictures/audio.

New model incoming

Can these things take any action you would in a browser without getting trivially blocked? I just bought a 128GB rtx spark to implement this in house for a family of 4. I have observed you don’t really need high tps to achieve things like “book a ticket for Dune 3 for 4 where the seats are together, preference for near the middle vertically and horizontally).

The rtx has decent prefill speed and enough memory for both context and using a dense model to prevent hallucinations resulting in poor browser calling.

Ironically the relatively low tps makes the real flow very akin to what I actually would do in terms of speed so I doubt it could be detected as chrome web driver isn’t used.

> How much novelty can there be?

Infinite

No