Comment by amelius

The problem with language models is their bias. Train a model on pure math and THEN when it starts talking by itself about consciousness (*), then we can say: that's odd.

(*) of course in its own language