Comment by docheinestages

Look into FastContext by Microsoft. Not extraordinary but specifically designed for paired usage with a larger LLM to save tokens [1].

[1]: https://github.com/microsoft/fastcontext