phantompeace

Not sure if I agree. Remember the error rates stack up every turn of the conversation. If a 2bit model is 10% more wrong than the fp16 version, over 10 turns that adds up

Only real ones remember 110MB

History will look back on people like you quite unfavourably.

Listen to yourself.

Nobody called anyone schizophrenic. They noted that the irrelevant link spam in a reply was reminiscent of schizophrenic posting. If you've spent any sort of time on places like 4chan, you'd understand. I don't think posting the HN guidelines is warranted here.

Care to explain how the terroristic Epstein Regime triple tapped a school in Iran recently? I'm waiting for your admonishment

I'm not surprised given the incessant bot activity. Top contributors are most likely bots. Other than that, I remember Ghislaine Maxwell as being a supermod across multiple high profile subreddits, so banning them seems like a good move.

Why did you consciously click into this article and comments section if you don't want to hear about it? You're free to scroll on at any time.

Which recent jailings were made for social media posts? Are you talking about the ones where people invited violence against migrants in hotels by calling for things like setting fire to their dwellings etc? Because that's a crime regardless of posting it on social media.

Commonly referred to as the Epstein Regime

Considering the very small difference between just SFT on the student model as compared to SFT + DPO on a proxy, doesn't it make sense to concentrate on ensuring the SFT dataset is perfect rather than sorry about DPO etc? And just train directly on the student model?

Why are we believing in marketing lies? For instance, crypto is useful (in a narrow context) even if it's 99.99% scams, and has positively impacted at least some people (the unbanked), even if it fell short of replacing the world's banking system. It's good tech.

Similarly with LLMs, it's good tech, but I do not believe for a single second that these things will ever replace anyone who is remotely skilled. People will be augmented by them. They won't be fully replaced. Well, I hope not anyway.

Do you really think an LLM will replace a surgeon?

How do you know it's being served at wildly below cost? AFAIK API pricing across the board is actually higher than what inference would cost? Yes there are subscription plans that subsidise tokens but they exist primarily to hook people in, so as to encourage their workplace to adopt it, whereby they then have to pay for an enterprise plan with zero subsidies like the subscription plans have. Training is very expensive, but you only do that once.

I predict costs will fall.