Comment Comment by aaroninsf TL;DR you ground symbols by connecting them to non-linguistic features in your network. In specific, to the sensorium; but also: to utility.Things have names, but things are what we perceive about them and largely about what we can and do, do with them.This is what any agent embodied in an environment must do and do do.Many of the criticisms about LLM will evaporate for multi-modal models, as they become multimodal, and gain (or infer from) agency. parent aaroninsf 3 years ago
Things have names, but things are what we perceive about them and largely about what we can and do, do with them.
This is what any agent embodied in an environment must do and do do.
Many of the criticisms about LLM will evaporate for multi-modal models, as they become multimodal, and gain (or infer from) agency.