fawazishola
Joined 1 year ago
Karma
10
Submissions
5
Member since
Jul 20
BUilding Axiom
View on Hacker NewsJoined 1 year ago
The shell doesn't talk to the LLM directly. They're separate processes. Alexitha monitors system state via cgroup events and adjusts scheduler weights. Flux is just the user-facing shell. They're connected through Tenet (the scheduler), not through a direct pipe.
Yes, the LLM is swappable. Alexitha is currently a fine-tuned 7B model, but the interface is not model specific. Any model that can read a cgroup event stream and output a scheduling decision can be slot in. I'm planning to test with smaller models (1-3B) to reduce boot overhead.
But you raise a good point; I should probably document the integration story better. Thanks.