Ask HN: How do you manage on-prem servers?

What is the best way to (/how do you) set up on-premise servers to give end-user engineers a cloud-like experience (keeping track of which servers are in use, remote SSHes, network configs, CI/CD, etc)?