It's possible, yeah. The system is general enough that it would work.
I'm considering exposing an API version. You set up a shared memory, then you hit the API as if it were an LLM. The underlying model could be configurable, the shared memory would be handled opaquely.
I'm considering exposing an API version. You set up a shared memory, then you hit the API as if it were an LLM. The underlying model could be configurable, the shared memory would be handled opaquely.