alibero

> Well first we should rob a bank...

This is sometimes called "instrumental convergence" in the AI safety world. Certain things (money, compute resources, safety from being turned off) are generally useful for an AI, and so we'd expect that a misalligned AI would attempt to acquire these things if given almost any substantial task.

Thank you for this excellent post series. It reminds me a lot of the pre-LLM days, though I was mostly using LSTMs back then. When the original GPT paper came out, I thought the future would be using LLMs to generate tons of synthetic labeled data and then training specialized LSTM or transformer models per-task.

Had a couple of questions:

1) You note that ARC-AGI is a meta-learning task, have you tried any meta-learning algorithms such as MAML?

2) Do you think this approach could extend to ARC-AGI 3? Or do you think the interactive environments require a higher level of complexity than what can be achieved with a small model?

The current trajectory is also a mass dying of humans so hopefully we can thread the needle there.

I've been looking into this. There seems to be some mostly-repeating 2D pattern in the LSB of the generated images. The magnitude of the noise seems to be larger in the pure black image vs pure white image. My main goal is to doctor a real image to flag as positive for SynthID, but I imagine if you smoothed out the LSB, you might be able to make images (especially very bright images) no longer flag as SynthID? Of course, it's possible there's also noise in here from the image-generation process...

Gemini really doesn't like generating pure-white images but you can ask it to generate a "photograph of a pure-white image with a black border" and then crop it. So far I've just been looking at pure images and gradients, it's possible that more complex images have SynthID embedded in a more complicated way (e.g. a specific pattern in an embedding space).

Later down the line, if you want to have separate behaviour for task deadlines vs payment deadlines, you're going to have to go through your codebase and look at every call to set_deadline and figure out if it's being used to set a task deadline or payment deadline. If you have an inkling that the deadlines might need a different behaviour, the “good example” can save you an annoying refactor in the future.

It seems like VR is less than half of the investment by RL. In Meta's 2022 annual report, they say "Many of our metaverse investments are directed toward long-term, cutting edge research and development for products that are not on the market today and may only be fully realized in the next decade. This includes exploring new technologies such as neural interfaces using electromyography, which lets people control their devices using neuromuscular signals, as well as innovations in artificial intelligence (AI) and hardware to help build next- generation interfaces. ... *in 2023, we expect to spend approximately 50% of our Reality Labs operating expenses on our augmented reality initiatives, approximately 40% on our virtual reality initiatives, and approximately 10% on social platforms and other initiatives.*"

I'm not sure if Horizon falls into "virtual reality" or "social platforms" but it seems to be the latter: "For example, we have launched Horizon Worlds, a social platform where people can interact with friends, ..."

As one of the unsupervised dorks working on LLMs at Meta (not one of the authors here) I took it in a positive way :)

I feel like this is a boring answer but for me, I had to make a habit of it, and then it didn't feel so hard any more. I started doing a master's degree in my free time: when I started I barely had the energy to do anything outside of work, but now I feel like setting aside time for coursework is pretty natural.

For me I find I usually fall into a 2/2/2 pattern for forming habits*: The first two days are super hard, after about two weeks it starts to feel doable, after two months the habit is pretty set and I don't have to worry as much about falling off the bus.

* This entire pattern is probably a placebo but that's fine by me

Of course, your energy is not infinite. If you are trying to work crazy hours and fit in other taxing activities, you are going to fail at some point.

Yes, I skipped or paraphrased those parts of the bill to keep things short in a way that I thought made sense. But I think the message is unchanged with the full text. Namely that Section 230 would be amended to also state:

"NO EFFECT ON CHILD SEXUAL EXPLOITATION LAW. Nothing in this section [NB Section 230] (other than subsection (c)(2)(A)) shall be construed to impair or limit ... any charge in a criminal prosecution brought against a provider of an interactive computer service under State law regarding the advertisement, promotion, presentation, distribution, or solicitation of child sexual abuse material, as defined in section 2256(8) of title 18, United States Code;"

And so Section 230 protections to content providers would cease to apply* in cases of child secual exploitation law, I think.

* EDIT: Except for those points that would be added to Section 230 specifically regarding E2EE

We do background checks, so hopefully we're not actually hiring people who tell big lies on their resumes.

> IMO for the hopper it is also not easy I agree. I'm changing jobs soon and have some apprehension for the reasons you mention, plus don't forget the fear of underperforming and being deported for losing my job :/

> the goal of the job is to get paid and support your family Parents and people who pass the vibe check get strong yeses from me so no issue there /s

But in all seriousness I do feel really bad when interviewing parents or anyone with other obligations that stop them from grinding practice questions if I have to fail them because they can't solve some BS leetcode question. Unfortunately my intuition if someone is a good engineer or not doesn't matter much if they can't crank out some leetcodes in 35 minutes :/