JaRail

Cool technique!

I just want to point out that something being science fiction does not mean it's impossible.

(March 2024) Antropic claimed Claude 3 Opus had "graduate-level expert reasoning" with GPQA results of around 60% showing a roughly phd level performance.

(Sept 2024) OpenAI claimed o1 was phd-level in their launch post.

You're kinda both wrong. :)

Yes and no. It would make the test fair but it would also mean losing any optimizations the vendors have made specifically for their model. They're all trained differently so they should be used differently to get maximum benefit. It makes sense to use each vendor's harness to get the most of their models, and compare the results that way. Additionally, it's not easy to use all the models in all the harnesses. Anthropic's subscription only covers claude code for example.

If it was just one test, sure. But if they're spinning these up continuously with new models on tens of thousands of GPUs, air gapping becomes impractical. I would mostly fault them on having no guardrails at all. They should have a monitor/external harness that looks for successful access to external networks then stop it there. They may as well let the models test their own networks for vulnerabilities. That's going to be really important to have going forward.

Has to be mixed. The model accomplished something truly impressive. We'll see how impressive when the zero-days are available look at. But OpenAI as an engineering company screwed up. The impressive part is mostly locked away from public access so I don't see a huge PR upside. The ugly part could bite them and the entire AI industry hard in terms of regulations. People will be citing this for years.

When that happens, I usually just do a manual update on my filters. More often than not, someone has already updated it.

Even programming questions. If it's something considered popular, you get awful results. Take javascript, I always append "mdn" when I'm trying to look up a language/api detail. Otherwise I'd be sifting through the top ten garbage Q&A or tutorial sites. In the glory days, Page Rank would return reference material first since it was so heavily referenced. But clearly that no longer works in the real world of SEO optimization.

Correct. The US only had net neutrality on the books for traditional ISPs. However, they were playing relatively nicely to avoid such regulation happening. The mobile arena was fought over data caps and exemptions rather than throttling.

Data exemptions are absolutely an example of a net neutrality violation. Similar things, like exempting partnered streaming music services from mobile data plans, have been shot down in Canada.

The fix was to block the botnets that were scanning millions of numbers and ban the associated accounts. Likely that includes some ongoing threat detection as well. That'll at least prevent scammers from collecting one more account name/number to attempt exploiting.

It doesn't do anything against a targeted attack against someone who has chosen to be discoverable. That's just how search/discovery is intended to work.

Hiding counts makes it hard to identify imposter accounts and bots. Users need to be able to see account age and counts at a minimum.

No, it wouldn't work. It only works if people can discover you with the "find people you know from your address book" feature. A deleted number won't match. Or you can just turn it off in your discoverability settings.