Recent submissions

Comment · 2 years ago
Wait, this 'Agents' thing seems to be just a way to couple a system prompt and temperature to a model, that's it?

What's the difference from sending the system prompt in the api call, as usual?

Edit: Oh, missed that: "We’re working on connecting Agents to tools and data sources."

Comment · 2 years ago
> Additionally, when people use CriticGPT, the AI augments their skills, resulting in more comprehensive critiques than when people work alone, and fewer hallucinated bugs than when the model works alone.

But, as per the first graphic, CriticGPT alone has better comprehensiveness than CriticGPT+Human? Is that right?

Comment · 2 years ago
> Notices: Apple's rights in the attached weight differentials are hereby licensed under the CC-BY-NC license. Apple makes no representations with regards to LLaMa or any other third party software, which are subject to their own terms.

Wait, they can do that? Assuming weights have copyright, shouldn't the finetuning be a modification of the original work and so have the same license?

Comment · 2 years ago
The title is wrong: this is about ChatGPT Plus, not GPT-4.

Specifically, the author is investigating (possible) changes in the system prompt and tools available to the model in the chat interface of ChatGPT Plus. That tells nothing about the model (GPT-4).

Comment · 3 years ago
That, I always have difficulty with these types of replies.

What should you do when someone, in a serious discussion, says that the Earth is flat, with a straight face?

Are they mocking you? Perhaps mocking the debate at hand? Are they trolling? Or maybe they are just naive and don't know that they are embarrassing themselves?

Maybe just treat them as a troll? But the thing is that when they appear just as some naive, maybe young person, the generous take would be to explain the ridiculous thing they are saying.. but I always feel so fool when I do that. Plus, I don't have the patience anymore.

Comment · 3 years ago
on my firefox it didn't work, just keep asking to connect a security token, with no other option. Firefox 116, Ubuntu 20.04, had an Yubikey in the past, never used passkey.

I think it's asking for the old yubikey, but neither the site nor firefox give me other option or a link about what to do.

Comment · 3 years ago
AFAIK the main difference is in certain provisions designed to block the use of patents to restrict the fundamental freedoms that GPL allows to the user. The main drawback is that it's incompatible with GPLv2-only software, but for new software it doesn't seem to be a problem.

Also, maybe A-GPL could be a good license here. It adds a provision that if the user accesses the code remotely (as on a server), you should share the code too. The default GPL only requires that if you distribute the binary.

PS. not a lawyer, would be happy to be corrected if something I said was wrong

Comment · 3 years ago
While the article has an obvious point of view, it cites other people defending their view , with plenty of links, and even the response from Harvard ('we don't comment individual investments'). The person that Harvard hired to be their ethics monitor resigned over this. It's not some invention from the head of someone.
Comment · 3 years ago
Is someone using some old phone, but with a recompiled kernel, to support standard linux features, like docker? It's possible in theory, but still didn't found someone doing it.

Seems that running docker in an old android repurposed as a server is still too much niche, unfortunately.

Bonus if it can run KVM with hardware support, but I don't know if it's possible yet.

Comment · 3 years ago
If your loss goes from 5% to 1%, you have to deal with 80% less heat. So you can make 3x smaller motors. All the powertrain of these machines will be hugely simplified.

That's no small deal, but in the grand scheme of things that a hot superconductor can give us.. I mean, this can (possibly, with decades of research) give us fusion, quantum computing, etc.

Comment · 3 years ago
For inference, at least locally, the bottleneck is usually the memory bandwidth (and quantity, of course).

I hope that AI hype lead us to more memory and more memory bandwidth, because they are really lagging behind computer power increase from like 15 years already.

Comment · 3 years ago
That's an interesting math. I don't think they are using 4 bits, or even 8. My bet would be with 16 bits. (Bear in mind that's just speculation, for "math's sake").

So we are talking about 4x your numbers per specialist model:

180GB * 4 = 720GB. If you count the greater context, let's say 750GB.

Anyone remember how many specialists they are supposedly using for each request?

If it's 2, we are talking about 1.5TB of processed weights for each generated token. With 4, it's 3TB/token.

At 0.06 for 1k tokens we get

3TB*1k/0.06 = 50 petabytes of processed data per dollar.

Doesn't seems so expensive now.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton