The fact that LLMs can recognise ASCII-art letters is actually the most impressive part of this story to me! Yes, they're trained on text, but they mostly only "see" byte sequences. They don't "see" letter shapes in the text they're given.
I wonder what parts of their training data helped with that skill?
I wonder what parts of their training data helped with that skill?