Comment by inf3cti0n95

The problem is, I have to build a generic deployment system for the researchers. To deploy their Model.

Inference frequency would be quite low, but multiple models could be deployed at time.