Comment by orena

How many epochs did you train with ? 100k hours is not a lot for an LLM, Feels like bitter lesson