jadermcs

Current tokens are very problematic, they are constructed by frequency, but frequency doesn't capture morphology and syntax that well. If the model learn how to tokenize internally it's way better then forcing an incorrect tokenization.

Tokyo has almost 15 million and works very well as a city. China is building many new cities close to the big cities to allow housing. The young population needs to live in the big cities because where the jobs are. Freezing prices will not solve the problem for the vast majority of the people besides the ones that were lucky to born in the place before the freeze.

The solution to house prices increase is to build more houses, but the protests demand to freeze prices instead of building more. Are they dumb or is it intentional to keep their cities small and exclusive?

basic mathematical expectation, positive * chancep + negative *chancen. People smoke knowing there’s a chance to kill them because the positive outcome outweighs this risk. Creating AGI/ASI can solve every human problem, so the risks is taken, but this doesn’t mean you have to put uranium in your cigars, or do RSI.

Omniscience doesn’t imply that you have to store all the information, but that you can retrieve/reconstruct it, and reasoning allows it. In fact would be impossible for any physical intelligence to store all the information as plain as it is infinite.

There's data in verifiable domains where a model can learn through the environment (e.g., math or coding), but some data is necessarily human experience. For instance, "what is the best ice cream in Malaga?" no matter how capable current AIs are they are not capable to get this information, there's no embodiment or simulation of human experience so far, if it's not in the labeled data they will just hallucinate the answer.