ilia-a
Joined 6 months ago
Karma
41
Submissions
40
Member since
Apr 26
Joined 6 months ago
Still a bit raw, but getting there
Works fine, yeah it only compresses command output so only input tokens are affected in terms of "compression".
That being said, I do have to wonder why someone as bug as say Uber, simply not rollout OSS model in the cloud for their team, I'd imagine that would be cheapest & most flexible option, while also keeping all the data shared with LLM private.