Comment by verdverm

One issue you will encounter is that many of the LLM calls are hidden and nested below abstractions in tools like LlamaIndex. You will need to integrate with these libraries or users will not be able to get the granularity needed.

See LangFuse as an example. It is what I am using