Hi! Yes we use something similar at Revision.ai to analyze student short, long and recall-based answers. The context of their studying content is considered when providing feedback in more ways than just the "correctness" of their answer.
When you say "leave small details around concepts that LLMs make mistakes on", do you imagine any way to do this for a variety of source material? Let's just say you have the course lectures, and several questions with curt answers. Can that be useful then?
When you say "leave small details around concepts that LLMs make mistakes on", do you imagine any way to do this for a variety of source material? Let's just say you have the course lectures, and several questions with curt answers. Can that be useful then?