TensorRT, like many other frameworks, has always been really cool in GenAI demos and essentially useless and unused because no one integrates those demos into the more fleshed out projects.
And TensorRT in particular is a pain for end-users to install correctly, especially when they gate parts of the stack behind sign-up walls.
And TensorRT in particular is a pain for end-users to install correctly, especially when they gate parts of the stack behind sign-up walls.