Handrolled Assembly will be better, but i preferred code i can read and understand.
MDMA is faster than llama.cpp in some models, because i did read the c code and rewrote it better. Rust is not the cause, i could the C code and open a PR and then hope it get merged.
The point of MDMA is you can have multiple nodes providing models while your main mode see all of them.
Handrolled Assembly will be better, but i preferred code i can read and understand.
MDMA is faster than llama.cpp in some models, because i did read the c code and rewrote it better. Rust is not the cause, i could the C code and open a PR and then hope it get merged.
The point of MDMA is you can have multiple nodes providing models while your main mode see all of them.