Recent submissions

Comment · 10 months ago
I hope this isn't Opus 4.5
Comment · 10 months ago
Not true anymore since Gemini 2.5 pro

I have quizzed it with three books (total more than 1500 pages) and it gave great answers.

Initially yes when they released 2 million context with Gemini 1.5 it wasn’t effective.

Try it with Gemini 3 pro/flash now.

Comment · 10 months ago
“But clearly the difference between LLMs in 2025 and 2023 is not as large as between 2023 and 2021.”

This is a ridiculous statement. A simple example of the huge difference is context size.

GPT-4 was, what, 8K? Now we’re in the millions with good retention. And this is just context size, let alone reasoning, multimodality, etc.

Comment · 1 year ago
Easier to debug deterministic inference
Comment · 1 year ago
Comment · 1 year ago
Really? Mansplain? Why bring gender wars terms into this.
Comment · 1 year ago
Doesn't OpenRouter ranking include pricing?

Not really a good measure of quality or performance but of cost effectiveness

Comment · 1 year ago
I wouldn't call the inflation that ravaged the world and real estate prices beyond the means of the middle class "saving".

His quantitative easing and zero interest rate policy only saved asset managers and corporate balance sheets.

Comment · 1 year ago
Noam Shazeer is not any guy. And I would bet the latest jump in Gemini capability is a result of him coming back.
Comment · 1 year ago
This is my observation as well. Recent market gains doesn't reflect how inflation eroded most people purchasing power.

People today are worse off than before Covid even though the market is much higher.

Debt fueled growth (through quantitative easing and deficit spending) is not healthy and always has a bad ending.

Real economic growth is what was seen between 1950 and 1970 where purchasing power increased and most of the gains went to the middle class.

Comment · 1 year ago
Moore's law is exponential
Comment · 1 year ago
Parent poster did say they are aware they don’t know but can’t express it.

I am guessing he is referring to mechanistic interpretability research like these:

https://arxiv.org/abs/2405.16908

https://arxiv.org/abs/2407.03282

You are claiming they are statistical parrots, which I don’t think the parent poster meant.

The “statistical parrots” argument might have been compelling with GPT-3, but not with today’s models and the results of mechanistic interpretability research, which show internal representations and rudimentary world models.

Comment · 1 year ago
The issue here is that, even with a lot of VRAM, you may be able to run the model, but with a large context, it will still be too slow. (For example, running LLaMA 70B with a 30k+ context prompt takes minutes to process.)

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton