Comment by iforgotmypasswo

This is so far beyond me, so I’m going to ask and hope someone knowledgeable is here:

Could this idea of reasoning through fundamentally different (it sounds like?) models be used to link even more distant models or systems?

If you can make a small leap, then you can construct bigger leaps through a chain. What else can latent space link to?

Instead of tool use through text, tool use through analog signals?

Instead of language prompts, analog sensors?