samsartor

... quadratically better

No, the probability distribution is the same. Watermarking changes the rng sequence used to pick from that distribution.

I want to agree with this. My fear is that governments and corporations love using technology to launder evil shit. Once security is automated, entire groups of people can be quickly and effortlessly disenfranchised by flipping a bool on a server somewhere. No appeal, no recourse, no human faces. You get to find out from some LLM that you aren't allowed in the country anymore because the "algorithm" identitifed you as a risk. uwu so sawd

It only works if the "intellence-driven security" is being developed in good faith.

The premise of this post is that tech founders used to be admirable nerds, but have since changed. I wonder if it isn't the other way around. We're the nerds. Us. Here. We used to admire tech founders because sometimes they were nerds too, but then we changed. We grew up. We got wise to it.

The author wants founders to stop projecting “an obsession with wealth and power” and instead “focus carefully on projecting an obsession with core nerd values”. And maybe it doesn't occur to them (as a fellow nerd) that _wealth and power were the whole point_. The author enjoyed being blind to the greed of it all, and now being unable to unsee they are begging the founders “please please just pretend a bit better”.

Elementwise equality! Given two dataframe columns or ndarrays, users often expect `==` to give out a column or ndarrays of bools (like `+`, ``, `*, `&`, and just about every other binary operator).

Personally I think it's fine to use "diffusion" to refer to the whole family of models

Yah I think E2E-TTT is a lot more like what people in this comments section are picturing. I can't tell that this method updates model weights at all during the "sleep" period, only the usual SSM state updated by any Mamba model after each token. They just optimized the model to use that SSM state _more_ when an eviction is about to happen.

The abstract and method sections only mention updating the SSM state during "sleep" (ie the same vectors that change after each token in stock Mamba) not any of the actual weight matrices. AFAICT this is just another attention compaction paper, with misleading tile? It is not very clearly written

Under the hood, the StartWRT UI is just another OpenWRT package, and it plays nicely with luci.

I helped a bit to develop this UI myself. Support for vlans was baked into it from day 1. The idea being good admin/guest/iot/hosted/etc separation without extra access points.

My understanding is that humans have very limited genetic diversity compared to most other animals, because of the population bottlenecks we've been through. And further, that diversity is mostly between individuals, not between groups. The distinction is easy to see in cats vs dogs: they both have similar overall genetic diversity but two Chihuahuas have virtually all the same genes (the small angry ones) while two tabby cats are more distinct. The two cats have different combinations of big/small nice/mean smart/dumb, but the genes average out to the same "typical" kind of cat in both cases.

Because humans get around so much, and because we think interesting-looking people are hot, the diversity is spread pretty broadly across the whole population. The average european person and the average east asian person are a little bit different genetically, but way less different than any two real europeans or two east-asians are to one another.

In short, the distributions of individuals overlap so much that the trendlines are pretty close to useless. And historically speaking, the people who tried to make a hard distinction out of those trendlines had awful motives.

I think that this is something of a misunderstanding. There isn't a litteral RISC processor inside the x86 processor with a tiny little compiler sitting in the middle. Its more that the out-of-order execution model breaks up instructions into μops so that the μops can separately queue at the core's dozens of ALUs, multiple load/store units, virtual->physical address translation units, etc. The units all work together in parallel to chug through the incoming instructions. High-performance RISC-V processors do exactly the same thing, despite already being "RISC".

I feel like my papers are better for having gone through peer review, and I'm a better researcher for having had a few rejections. Of course the reviewers can't hover around in your lab watching everything you do. But even if reviewers can't check the validity of the evidence in your paper, they do a pretty good job ensuring that the claims you make are supported by the evidence you present. That's a valuable if imperfect guardrail! What would be the alternative?