rar00

Joined 1 year ago

Karma
41
Submissions
36
Member since
Nov 26
AI Leader and Engineer @NVIDIA by day, AGI Researcher by night
View on Hacker News

Recent submissions

Comment · 9 months ago
Comment · 11 months ago
Really cool! An affective basis of homeostatic drive seems promising.

Have you performed any basic evaluation / test of your approach?

I'm also curious if there was any deliberation between pursuing "thinking" (language modality) versus "behaving" (visual modality)?

Comment · 11 months ago
typo? Rounding it up to 2 billion, 30% means 600 million per year
Comment · 11 months ago
hmm, can't tell if complete bullshit or a work of genius.

On the one hand, the approach overlaps a lot with my thinking, and has some original tweaks (like the emotionally valenced reward signals). Saying that as someone from a robotics/AI background nowadays involved in GenAI, with a few years of phd research on NeuroAI, curious about molecular neuroscience and the Free Energy Principle (as conceptualised by Karl Friston and Mark Solms).

On the other:

- this plausibility dilemma is the hallmark of LLMs

- has all the buzzwords imaginable

- no code, no raw outputs, no official confirmation (by ARC)

- Agentic AI play, walled demo page

I might just be too hopeful (and gullible)...

Comment · 1 year ago
I started reading two recent neuroscience books (elusive cures and natural neuroscience) that while have different goals both highlight the utility of systems neuroscience. In elusive cures the author presented a brief history of the evolving ideological currents where neuroscientists first only cared about about the specific brain region where a stimulus or disorder is happening (first-order effects), then decades later realised the importance of downstream and upstream brain regions (second-order), and are finally coming to terms that the brain is a complex system with coupled regions (third-order).

Seems the article is a contemporary example of the first->second-order realisation...

“This was a very unexpected finding given the current assumptions about how psychedelic medicine works”

"Surprisingly, psychedelic treatment was still able to strongly boost connectivity onto these neurons”

Knowing (those types of) psychedelics bind to serotonin receptors scientists studied neurons with such receptors and didn't focus on the others. Their study looked at other neurons and found plasticity changes there too.

Comment · 1 year ago
"As [Essential AI Labs (founded in 2021 by Vaswani)] changes focus, Vaswani is asking investors for at least $150 million."

expected, yet still funny. Noting that their initial aim was to capitalise on transformers to create business tools after GPT-3 came out.

Comment · 1 year ago
Comment · 1 year ago
I know people are pushing back, taking "only" literally, but from a reasonable perspective what causes LLMs (technically their outputs) to give that impression is indeed the crux of what holds progress back: how/what LLMs learn from data. In my personal opinion, there's something fundamentally flawed the whole field has yet to properly pinpointing and fix.
Comment · 1 year ago
That's an orthogonal concern IMO. Running a batch in Europe is about tapping into another source of opportunities. There are plenty of founders that won't or aren't able to attend YC in SF
Comment · 1 year ago
disagree, there are a few organisations exploring novel paths. It's just that throwing new data at an "old" algorithm is much easier and has been a winning strategy. And, also, there's no incentive for a private org to advertise a new idea that seems to be working (mine's a notable exception :D).
Comment · 1 year ago
yep, even with greedy sampling and fixed system state, numerical instability is sufficient to make output sequences diverge when processing the same exact input
Comment · 1 year ago
This argument works better for state space models. A transformer would still steps context one token at a time, not maintain an internal 1e18 state.
Comment · 1 year ago
getting a billionaire to finance your startup with 9-figures for no equity... :D
Comment · 1 year ago
It is a sensible position. YC and VCs are backing businesses, not charitable causes or research initiatives. It is the founders' responsibility to liaise the two sides in order to signal that the pursuit of their particular purpose is an undeniably attractive and fast-growing investment. Which obviously entails more work and has fewer market opportunities compared to the case "money is the purpose".

After getting backed and receiving adequate funding, all that matters is maintaining a good growth rate to remain a purpose-driven business.

Comment · 1 year ago
the robot arm demonstration video jumps at the 00:28s mark...

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton