moring
Joined 8 years ago
Joined 8 years ago
... who draw their wealth and power from society, because society decides they deserve it.
> Despite this, real-world LLMs still produce varying outputs due to factors like: > - Floating-point precision limitations
This by itself is deterministic, as per IEEE 754, as long as no parameters are "left to the implementation". The Java virtual machine had this problem before, and fixed all parameters to be deterministic. Depending on the hardware, this comes at a performance cost (if some hardware cannot support the chosen parameters) which is why the JVM introduced lenient floating-point to let the code choose between determinism or performance.
> - Hardware and parallel processing variability > - Decoding tie-breakers > - Other sampling parameters like top-k or top-p that may still introduce variation
I'm assuming this refers to different HW architectures, because hardware variability at the lowest level (silicon patterning and doping) is already dealt with by circuit designers. Again determinism can be achieved by prescribing the exact procedure, which the hardware must replicate in behavior but not necessarily in implementation. And again, this may come at a performance cost when specific hardware cannot implement the prescribed procedure at all, or only by keeping actual hardware parts unused.
--
All that said, I don't think that determinism is all that useful, because it only guarantees that the output will remain constant as long as you don't touch anything. In reality, you want the output to be "similar" as long as you only change "irrelevant" things, and determinism won't help you with that.
> Just like the other stack allocators we talked about, this one can also work in a multi threaded environment. You might be tempted to make the two updates transactional – like with a compare and swap loop – but it isn’t needed.
Unfortunately they don't explain HOW this is going to work...
Party A makes statement A,
Party B makes statement B,
Statements A and B are in contradition,
Party A claims that both parties agree that statement A is true,
Party B claims that both parties agree that statement B is true.
If you seek truth about reality, you better take humans out of the loop...
That statement itself is partisan. So is the meta-statement about who agrees with that first statement.
Really, any messy argument is about the claim who made which claims.
This is a very software-engineery point of view and totally false for the ordinary user. Heck, it is even false for me as a software engineer.
> since you know people like moving a mouse and clicking on buttons
No, they like well-designed user interfaces, and the UI design of a typical CLI is abysmal.
It's yet another xkcd-level apocalypse.
Not trying to downplay the time wasted to reject the PR, though.
But that would require the OS to know what a relevant URL is, so the permission must be scoped to a prefix, or maybe a regex(1) to be applied when the clipboard contains text content.
(1) restricted to "proper" regular expressions that don't have the security issues of Perl-style REs.