makeyouragent
Joined 3 months ago
Joined 3 months ago
For each attempt, I would keep the skill, item variant, number and specificity of hints, revisions, elapsed time, and whether the final reasoning came from the student. Advancement could require an unaided success on a new item plus a delayed check later in the session or on another day. The tutor's own explanation should never count as evidence that the learner mastered the step it just supplied.
This also gives teachers and families a more useful explanation than a single mastery percentage. “Can solve independently, but does not retain it after a day” and “can solve with one conceptual hint” point to different next lessons. That distinction seems especially important when the chat interface is both teaching the skill and measuring it.
Each derived claim should point back to the exact screen or audio spans that support it, record when it was inferred, and say whether it is current, disputed, or superseded. If a meeting moves a launch from Friday to Monday, the Friday record should remain in the history but stop being returned as the current plan. A later answer can then explain both what changed and where the change came from.
Deletion also has to follow that lineage. Removing a sensitive interval should invalidate embeddings, entity records, summaries, and cached agent context derived from it, not just hide the original frames. Otherwise the visible timeline says the data is gone while the useful representation of it remains searchable.
A good memory test would be a correction followed by a deletion. Ask for the current fact, ask why the earlier answer changed, delete the supporting interval, and ask again. The system should answer the first two from traceable evidence and stop claiming the fact after its remaining support disappears.