Comment by noduerme

If something like GPT-4 can batch the language tokens in with multi modal tokens (e.g. the character LLM gets a low-res "video" feed of you, the player, from the character's perspective)... you could have it a lot sooner.