ucha

Joined 14 years ago

Karma
2,705
Submissions
433
Member since
Oct 23
Quant trader. Former software engineer. Mathematician by training.
View on Hacker News

Recent submissions

Comment · 2 months ago
Comment · 3 months ago
For a set parameter size, if you benchmark an LLM on a single language, you'd get better results by training it on multiple languages rather than just the one. Scaling quality training data almost always increases performance as the neural network picks up general rules and an understanding of code that are language agnostic.
Comment · 3 months ago
That's not how LLMs work. If you're talking about number of parameters, you wouldn't be able to reduce the size much by "removing" support for other languages.
Comment · 3 months ago
Why add a middleman when you can ask your own account with /usage?
Comment · 11 months ago
n=56 doesn't give you much information regarding the margin of error, unless you practice Tarot Reader's cat science. The standard deviation of outcomes and the difference between both outcomes matter just as much.

If I flip a coin 56 times and it always falls on head, I can be pretty much certain that it's not a fair coin. I wouldn't need to flip it 1000 times. We are all someone else's "know-nothing hack"...

Comment · 1 year ago
Can we know for sure that the price drop is accompanied by a change in the model such as quantization?

On twitter, some people say that some models perform better at night when there is a less demand which allows them to serve a non-quantized model.

Since the models are only available through API and there is no test to check which version of the model is served, it's hard to know what we're buying...

Comment · 1 year ago
It needs to not have economic value but it doesn't necessarily need to be useless and wasteful.
Comment · 1 year ago
You can have growing deficits without actually "selling the nation" when you account for growth and inflation.

Say foreigners own 50% of US assets. When someone creates in the US a company ex nihilo and sells 10% of it to foreign investors, even though foreigners bought more US assets, this new wealth creation causes the % of foreign-owned US assets to diminish.

When foreign investors own US bonds, as inflation increases and the money supply increases, they end up owning less in real terms.

This doesn't account for investments that are limited in quantity such as real estate.

Also just because those are opposing forces, doesn't mean that foreign ownership wouldn't increase. As a matter of fact, when looking at the foreign ownership of US stocks, it has been steadily increasing.

Comment · 1 year ago
Does this support the Selfish Gene theory of Richard Dawkins? They look like the smallest self-replicating molecules that he mentions in the beginning of the book.
Comment · 1 year ago
Maybe you're polling the people that wanted to join before 2022? Otherwise, how would the jump in support in 2022 be explained?

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton