Comment by gdevenyi

I had this working with the FreeToken inference engine a month ago when they launched.

https://github.com/FlashML-org/FreeToken