Some HPC Clusters, xgboost, read pretrained model from NFSRDMA Server, read data, parallelise over MPI with one process per model. And the latest Zen5 Epycs. I could do it all on just one of the 192 cores EPYCs but we like to parallelise it over multiple machines to get the extra speed and reliablity.
It wasn't that expensive, the main problem was the storage bottleneck which got fixed with just some LVM cache and gen5 ssds.
It wasn't that expensive, the main problem was the storage bottleneck which got fixed with just some LVM cache and gen5 ssds.