Comment by bragr

People don't seem particularly motivated to move away from CUDA to me. I've been poking around various models and tooling over the last couple months, and they pretty much all have something like

  device = "cuda" if torch.cuda.is_available() else "cpu"

and I've yet to see a single one implement the AMD NN middleware: https://www.amd.com/en/developer/zendnn.html