So..
If the 'source' of data is 9gag, 4chan, you will get 'this' material.
If you feed it Tumlr, you will get Harry Potter and rope-porn-thingies.
If you feed it Hitler's speeches, you will get 'that' material.
If you feed it algebra, you will get 'that' material.
Then..
Do we want 'open' or 'curated' LLMs?
And how far from reality are the curated LLMs?
And how far can curated LLMs take us (black Nazis? female US founding fathers?).
Pick your poison I say.. and be careful what you wish for. There is no "perfect" LLM because there is no "perfect" dataset, and Sam-Altman-types-of-humans are definitely deeply flawed. But life is flawed, so our tools are/will be flawed.
Then.. Do we want 'open' or 'curated' LLMs? And how far from reality are the curated LLMs? And how far can curated LLMs take us (black Nazis? female US founding fathers?).
Pick your poison I say.. and be careful what you wish for. There is no "perfect" LLM because there is no "perfect" dataset, and Sam-Altman-types-of-humans are definitely deeply flawed. But life is flawed, so our tools are/will be flawed.