Comment by tarasglek

Colbert, colqwen are underserved would benefit from a latency optimized inference service