technoabsurdist

hi I work at wafer. yes we ran benchmarks. for example our Kimi K3 is live on open router and in order to host there you have to run accuracy checks. like tau/gpqa.

and then u must pass test regarding thinking, coherency, and tool calling

sounds good feedback taken, thanks beffjezos

hi yes it’s not optimized for single stream it’s optimized for total node throughput

this is exactly our thesis at wafer :) thank you for the support

AMD MI355X uses 1,400W per GPU and NVIDIA B200 uses 1,200W. So AMD uses about 16% more power.

yes it is 213 tok/s single stream (so per user)

hi i work at wafer. no the margins are lower averaging at about ~40%. utilization is one of the highest order bits in determining margins here, yes.

^ We currently just have llama3.1-8b, so we'll be working on adding more models across more hardware options!