I've been building an app in pure C using onnxruntime, and it outperforms a comparable one done with python by a substancial amount. There are many other gains to be made.
(In the end python just calls C, but it's pretty interesting how much performance is lost)
(In the end python just calls C, but it's pretty interesting how much performance is lost)