Comment by nottorp

Is there some kind of tutorial for installing these (and their dependencies) somewhere?

One that assumes i can set up python modules and compile stuff but i have no idea about all these LLM libraries would be enough thank you.