Comment by Ardon

The only well-reviewed DisplayPort KVMs I'm aware of are from Level1Techs: https://www.store.level1techs.com/products/kvm

Not cheap though. And also not 100% caveat-free.