The elephant in the room here is that these LLM's still have problems with hallucinations. Even its only 1% or even 0.1% of the time thats still a huge problem. You could have someone go their whole lives believing something they were confidently taught by an AI which is completely wrong.
Teachers should be very careful using a vanilla LLM for education without some kinds of extra guardrails or extra verification.
Teachers should be very careful using a vanilla LLM for education without some kinds of extra guardrails or extra verification.