Comment by Iv

"Starting from a single base LLM"

Ok, zero data, except the data used in the teacher model.