Comment by TchoBeer

I am thinking that the latter might eventually emerge, probably as part of a bigger tool chain e.g. langchain. Something like java bytecode which is low level and portable, but optimized for the ways that LLMs (perhaps interfacing with other tools) work.