Comment by static_void

LLMs are terrible at writing hip-hop because they can only move forward.

Hip-hop is just natural language with extra constraints like rhythm and rhyme. It requires the ability to edit.

Similarly, types and PL syntax have more constraints than English.

Until transformers can move backward and change what they've already autocompleted, the problem you've identified will continue.