I recently got my feet wet with Nix for the purpose of agent sandboxing, and it's a really great concept!
The issue I have run into is that for running llama.cpp, which is a very actively developed bleeding-edge software, it seems like experimenting with different versions/configs/patches etc. was fighting with the Nix philosophy of immutable software, so I ended up just managing it outside of nix.
But this could be user-error, I've only spent a couple of weeks with it.
The issue I have run into is that for running llama.cpp, which is a very actively developed bleeding-edge software, it seems like experimenting with different versions/configs/patches etc. was fighting with the Nix philosophy of immutable software, so I ended up just managing it outside of nix.
But this could be user-error, I've only spent a couple of weeks with it.