Real-time LLM Inference on Standard GPUs: 3k tokens/s per request b blog.kog.ai 219 NicoConstant 5 months ago 97 comments
Kog AI – Building a Real-Time Inference Stack on AMD Instinct GPUs [video] y youtube.com 8 NicoConstant 5 months ago 0 comments
