benlivengood
Joined 7 years ago
Joined 7 years ago
On one hand you have slots/roulette/craps gambling where payout or loss is immediate. Next come candy crush style games where time invested per session is minimal but extant, but reward continues to stream with flashy graphics for accomplishing subgoals. Next come longer-term games like 4x or tower defence where there's progression or some sort (often available to skill or how much time you have to spend) where payoff is delayed to the end but there are still progress rewards like new technology or beating a wave of enemies. Finally RPGs and MMOs where there is (often) no final payout but leveling up, completing quests, acquiring special items, etc. happens at a pace that rewards time spent. At no time is the next step mysterious; there's a journal with next steps which will each provide their own rewards.
Contrast that with real life where reward is on a fixed schedule (N paychecks a month) with no short-term feedback on performance. At best a short "good work" reward fairly rarely from management. There are subtler rewards people get like socialization or status, but they aren't on a quest journal and they arrive less frequently for most people.
I think for extroverts in high social contact jobs it may actually be as rewarding as gaming, e.g. direct sales.
Contractors and spot workers (day laborers, etc.) also get a bit more frequent reward feedback, but far fewer rails unless it's a very canned pipeline of clients.
Contrast with the ancestral environment where hunting or gathering had minutes or hours between reward feedback and our natural senses and instincts provided a lot of the rails (hunger, visual attention to animals and edible plants, potential mates).
If you want your customers to believe they won't be hung out to dry when the broader community patches before they can because you're no longer in the loop, you cooperate.
It's not like this is the last 0-day that will need to get patched and deployed in a hurry. "Not slower to patch than virtually anyone else" is a pretty sustainable place to be.
Back in the day it was tractable to build AES lookup tables for computing MixColumns and SubBytes similar to the site's multiplication table. Then djb found a remote timing attack, so processors started implementing hardware AES instructions.
Specifically, there were "lost property" and "honesty" neurons that drove the answer to return a lost wallet in Kimi K3.
That's the big news of this article, that concepts are finally becoming human-legible for many neurons in mechanistic interpretability.
I also don't exclude the possibility of formally verified C code like seL4 having no RCEs, etc.
I love C and wrote some CGIs in C in the past but I don't love concurrent programming in C. While forking and execing can use shared read-only mmap on .text segments, the .bss and .data will need initialization and copying; there's unavoidable startup overhead that a threaded process avoids, and raw pthreads is kind of painful. If all you need to do is serve a low traffic site, CGI is fine.
My biggest worry would be how often the SQLite DB gets backed up because there's no way a C web server will be free of RCEs in today's world.
Similarly if the formal Lean problem statements (human generated) are correct translations into Lean (and the original NL statements are sound, which one would hope after decades), and no Lean bugs are abused by the proof (as defined above), then the proof is valid.
The NL/Lean discrepancies are super annoying and will make human analysis hard and fraught, but as many posters have found out the models themselves will gladly pick apart the NL-Lean translation for errors, and so my guess is that finding the discrepancies will not take too long. OpenAI really should have done a dynamic workflow over every lemma and step to ensure pointwise accuracy in the translation.
I combined it with Zot for an OCI registry but there are quite a few choices there.
Great; let's design and fund a study of the development of artificial intelligence that's as causally divorced from the ~extropian days as possible and see what they come up with. Barring that:
Basically that is what we have up until the early development of transformers; I don't think the authors of early deep learning or transformers papers were part of the rationalist sphere. The rationalists famously didn't believe neural networks or deep learning could achieve anything close to AGI.
So there are several diverse traces of intellectual development leading to modern estimates of AI risk and they vary from low to high without a lot of correlation back to the school of thought they trace back to. This leads me to believe that overall we have fairly good coverage of cultural ways of thinking about AI and AI risk, and aside from a minority of holdouts (LeCun) they have high enough x-risk or catastrophe estimates to take it seriously (e.g. >1% over the next few decades).
Apparently from standby the power-off time on some laptops is much longer and you get a MANUALLY_INITIATED_POWER_BUTTON_HOLD which kicks off in the ~8 seconds from the article.