My homelab has
1) a NAS/Server with 10700 + 12 TB HDD x 15 forming a ZFS, with 128GB of RAM.
2) A pair of machine learning servers, each of them with a threadripper 3955wx, 256GB RAM and two 4090s
3) A more powerful machine learning server, with a threadripper 5975wx, 512GB RAM and two 4090s.
All of them run NixOS. They are mainly used to serve a bunch of services: hydra/nix binary cache, shiori, grafana/prometheus, paperless, syncthing, filerun, assistant etc. And also training jobs all the time.
I would highly recommend NixOS to run on your servers for the services.
1) a NAS/Server with 10700 + 12 TB HDD x 15 forming a ZFS, with 128GB of RAM.
2) A pair of machine learning servers, each of them with a threadripper 3955wx, 256GB RAM and two 4090s
3) A more powerful machine learning server, with a threadripper 5975wx, 512GB RAM and two 4090s.
All of them run NixOS. They are mainly used to serve a bunch of services: hydra/nix binary cache, shiori, grafana/prometheus, paperless, syncthing, filerun, assistant etc. And also training jobs all the time.
I would highly recommend NixOS to run on your servers for the services.