Comment by anoncept

As a starting point, maybe take a look at the 'tch' crate [1] and the 'rust-bert' crate [2] built on top of it?

[1]: https://github.com/LaurentMazare/tch-rs -> https://crates.io/crates/tch

[2]: https://github.com/guillaume-be/rust-bert -> https://crates.io/crates/rust-bert