This is insanely fast, obviously a game changer over time. You should try the demo!
This seems to be using custom inference-only HW. It makes a ton of sense to use different HW for inference vs training, the requirements are different.
Nvidia, as far as I can tell, is focusing all-in on training and hoping the same HW will be used for inference.
This seems to be using custom inference-only HW. It makes a ton of sense to use different HW for inference vs training, the requirements are different.
Nvidia, as far as I can tell, is focusing all-in on training and hoping the same HW will be used for inference.
Exciting times!