Comment by richrichardsson

For LLM workloads this might help? https://docs.tinygrad.org/tinygpu/