Comment Comment by adeon I've counted three different Rust LLaMA implementations on r/rust subreddit this week:https://github.com/Noeda/rllama/ (pure Rust+OpenCL)https://github.com/setzer22/llama-rs/ (ggml based)https://github.com/philpax/ggllama (also ggml based)There's also a discussion on GitHub issue on setzer's repo to collaborate a bit on these separate efforts: https://github.com/setzer22/llama-rs/issues/4 parent adeon 3 years ago
https://github.com/Noeda/rllama/ (pure Rust+OpenCL)
https://github.com/setzer22/llama-rs/ (ggml based)
https://github.com/philpax/ggllama (also ggml based)
There's also a discussion on GitHub issue on setzer's repo to collaborate a bit on these separate efforts: https://github.com/setzer22/llama-rs/issues/4