Comment by rileyphone

There's a decent amount of research that supports this view [1][2]. How else do you explain the unreasonable effectiveness of transformer-based language models?

1. https://journals.sagepub.com/doi/pdf/10.1177/014272371986973...

2. https://arxiv.org/pdf/2301.06627.pdf