Hi - this is Adil the co-founder who developed archgw. We are working tirelessly to create a framework that would help developers write agentic application without having to write all the crufty/boilerplate code. At the very minimum we provide observability and logging without adding much overhead. You can simple plug arch gateway into your existing LLM application and you'd start seeing details like time-to-first-token, total latency, token count and tons of other observability details. I do recommend start tinkering with our getting started page here [1]
And for a bit more advanced use cases I do recommend looking at llm_routing [2] demo and currency_exchange demo [3].
We currently support providing seamless interface to major providers like openai, mistral, deepseek and also support hooking up to local providers like ollma [4]
And for a bit more advanced use cases I do recommend looking at llm_routing [2] demo and currency_exchange demo [3].
We currently support providing seamless interface to major providers like openai, mistral, deepseek and also support hooking up to local providers like ollma [4]
[1] - https://github.com/katanemo/archgw?tab=readme-ov-file#quicks...
[2] - https://github.com/katanemo/archgw/tree/main/demos/use_cases...
[3] - https://github.com/katanemo/archgw/tree/main/demos/samples_p...
[4] - https://github.com/katanemo/archgw/tree/main/demos/use_cases...