encrux

Welch Labs has a beautiful visualization in their YouTube video about Vision Language Action Models, where the attention of the prompt can be traced to the exact origin pixels in the image from one of those matrices.

This is impossible, or it’s going to be soon. LinkedIn just introduced a „this is AI-slop“-button and it remains to be seen if it’s used for good, or used to train better AI-slop.

It’s a losing battle in my view.

That’s fair, and I don’t mind this. All I‘m proposing is the option for platforms to use this method on their own.

If FB or IG don’t want to use it, fair. I‘m hopeful that there’s gonna be competition if there’s a system with little friction.

In my opinion: the only way forward is zero-knowledge-proof authenticated social media.

We can’t have legitimate debate if we have to assume a few bad actors are cloning their voice by the thousands, poisoning debate.

If we can pin one account to a real person, we won’t get rid of LLM-content and misinformation, but at least we can hold them accountable.

I don’t see any other way past this other than regulation:

We need authenticated online spaces where your account is linked to a real, government issued ID. This way, moderating content becomes feasible again. Bans will hold value, since you can’t just create new accounts all the time. I predict people will gravitate towards authenticated markets (and social media).

I for one am sick and tired of second guessing every text I‘m reading, at least give me someone to hold accountable.

Back when GPT-2 was released, I tried figuring out how to fine tune it. I found a google notebooks template, scraped a bunch of data from r/ChangeMyMind and asked it to change my mind on different topics.

I was dumbfounded that it actually tried doing that. Obviously GPT-2 wasn’t great at it, but the writing was on the wall quite literally.

Unfortunately, I was too broke to invest in stocks, but I did pivot my career quite a bit.

For everyone in the EU: Copying and pasting sensitive data (like customer data) into AI tools is a violation of the GDPR, and potentially the AI act, which will be enforced soon.

These violations come with hefty fines.

A friend of mine forked the repo and tried it with BPE (Byte-Pair Encodings), and it did noticeably improve performance.

Late reply I guess, but "Claude builds a C compiler" was the first thing I thought about when I saw that sensationalized write-up of Mythos.

It sounds awesome, but once you look deeper, there's no meat on it. I'd love to be blown away, but even 12 days later there's just... nothing.

Anything that beats alexa-level intelligence on an edge-device is what I'd call useful as well, which shouldn't be too hard.

It's mind-boggling how bad current voice assistants sometimes are when you prompt them some fairly easy questions.

Not really on topic anymore, but…

I keep wondering when this discussion comes up… If I take an apple and paint it like an orange, it’s clearly not an orange. But how much would I have to change the apple for people to accept that it’s an orange?

This discussion keeps coming up in all aspects of society, like (artificial) diamonds and other, more polarizing topics.

It’s weird and it’s a weird discussion to have, since everyone seems to choose their own thresholds arbitrarily.

For YouTube, this already exists and I‘m using it. The extension is caller DeArrow and aims to reduce sensationalism via crowdsourcing, though I wouldn’t be surprised if top contributors are bots using LLMs.