matiasmolinas
Joined 11 years ago
Joined 11 years ago
Two LLMs, two jobs: Claude Opus at dev time creates and evolves agents. Qwen3-VL-8B at runtime handles vision and navigation. The robot builds an occupancy grid from camera frames, uses A* for pathfinding. LLM picks strategy, math handles execution.
Same HAL runs on Three.js simulation and ESP32 hardware.
Alpha now, all TypeScript, Apache 2.0.
We are building LLMos, an OS where AI agents are first-class citizens. They perceive, reason, and will soon collaborate using distributed world models (inspired by RSA-LLM) and dual-model architectures (LLM + JEPA).
We are moving from simulation to real-world synchronization, allowing agents to share their "mental models" of the environment to outperform individual units.
Building this alongside Ismael Faro has been a journey of constant innovation. Read about the future of Physical AI