elliotbnvl

I had an Anthropic API key that was used in a Railway deployment be disabled due to evidence of unauthorized abuse ~3hrs after receiving the Railway security notice. They managed to spend about $20 in Opus 4.8 tokens before the abuse was detected. What a headache.

You could think of it as a more efficient indexing format for data the agent has access to. It’s badly needed as a better representation or pointer map would improve recall time and comprehensiveness dramatically without having to invest further in model training.

Oops. I took your comment at face value. Sorry!

Upvoting for visibility, not because I agree. This is really disingenuous, and quite a bad idea overall.

I’d make a joke about there not being a word for the reverse of plagiarism, except there is one: lying.

I went to the site and listened to the track. Sounds nice! But not having played the game I am lacking context.

What about the sound is so nice / interesting / soothing that drives you to these lengths? What about it do you like?

I find your whole project really fascinating. I want to do something similar at some point, even though I don’t have the same kind of sound capturing my interest at the moment.

Definitely an invasion of privacy. I can’t visit this website in good faith. It should be taken down.

The point is valuable, and the mission is important, but the ends do not justify the means. If this must be shared, at least use static pictures and don’t stream the content for viewers.

$500k is a vast overestimation. For massive concurrency at FP8 or even BF16 maybe.

NVFP4 at reasonable speeds (~120 tok/s) and concurrency is possible at a $80/90k figure with today's prices, maybe even less. That buys you 6 RTX 6000 PRO Blackwells, a decent CPU and motherboard, power supply. 576gb of VRAM.

You could do it for under $50k if you're OK with 40 tok/s decode, ~1200 tok/s prefill.

It's more about the trajectory.

It is insane that we are comparing locally-hostable models to leading cloud providers, it is wild to me that this article even exists.

We have come a long way, and very clearly have a long way yet to go.

I don’t foresee development timelines speeding up but I am seeing entire applications being built by one developer instead of four over the same timeframe. If anything communication overhead is reduced and velocity and quality are up, too.

I mean it is the butcher who knows how the sausage is made.