Comment by suryabhupa

In practice, and at scale, that's exactly what having <bos> and <eos> tokens allow you to easily and programmatically do.