Comment by Darth_Hobo

Their model is overfitted. If you type "What the fuck did you" it will output Navy Seal copypasta with almost no changes. No wonder why it sometimes generates human-like texts, because in some cases it literally spews out its training examples with minimal or no changes.