erdaltoprak
Joined 6 years ago
Karma
792
Submissions
34
Member since
Jan 1
Joined 6 years ago
If you want Qwen3.8-27B Serving Configs for the DGX Spark vLLM NVFP4 and RTX 4090 llama.cpp GGUF I added the setups here https://x.com/ErdalToprak/status/2088299678085308761?s=20
It supports containers, machines, registries with a menu bar app if anyone is interested by it
Not downplaying the immense work of infra / engineering at this scale but my neighborhood local grocery market shouldn’t be down