Comment by akbirkhan

this is pretty important when you move to LLMs as microservices (e.g. calling gpt-4 for some plan / then 3.5 for easier sub component).

Would be keen for a python implementation