mhjkl

If only someone had invented a technology for a decentralized ledger that could be used to store public keys back in 2009, but alas

People are downvoting me because they know I am right

How? You wouldn't need CA's anymore so there'd be no central point of failure to compromise

Blockchain would've solved this

If you adjust for writing speed, this model is already more efficient than humans. It can run at 233 tps on a 5090 which is roughly 10k words per minute compared to human typing speed of 80 wpm. If you duty cycle it down from 575 watts of 5090 to human speeds it’s about 5 watts.

This will make more money for Claude from individuals unofficially acting as meat puppets in more inefficient workflows

All big LLMs already visibly watermark all their text with easy to detect annoying phrases and turns of speech that everyone is already sick of hearing. Why do AI companies keep making their products worse to appease anti-AI, it’s not like they’ll suddenly start supporting it if you do so. If you’re worried about European customers, just relax your firewalls to let more VPNs through, if the productivity boost is high they will use it anyway if their rules keep crippling their own models

I’ve seen Chinese open weights models say “can’t use this if you’re in Europe” in their licenses, so I doubt they would invest too much into complying

You must not use any open source software, because much of it comes with a whole paragraph of ”IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY“

If you’re on AMD, use llamacpp with the vulkan backend. For the 35B I get around 115 tps without mtp and 150-170tps with it. Also the pcie slot you use affects it

I'd say Anki has more friction that writing physical cards though

How do you make these compressed prompts like that

This comment would go hard in a sci-fi novel 5 years ago

During the dot com boom they said data centers consumed 8% of US electricity. It was later proven to be a lie, created with fake studies by coal companies to trick the US into building more coal power plants using environmental activist outrage to implant the idea that the internet needs coal into the mainstream. Make of that what you will

Reminds me of the “Has The Turing Test Been Passed” website. It says no, but if you read on they cite “The relatively minimal funding allocated to AI research” as one of the reasons AI hasn’t been achieved “yet”. Website stopped being updated before it became relevant, so you will never see it say “yes”, similarly to how the Loebner prize mysteriously vaporized when GPT-2 came out, just when winning it for real started becoming an interesting possibility