Comment

Comment by alex_saroyan

Right. We instruct Kernel to reserve 8 CPU cores exclusively for our user space application that is responsible for traffic forwarding.

Here's performance results. Max latency is 0.31 msec.

####################################################

min_latency_ns: 708

avg_latency_ns: 63723

max_latency_ns: 310795

jitter_ns: 30940

####################################################

Regarding L3 PFC support. In my understanding it's a ROCE requirement. I view RoCE as east-west traffic, since its not leaving the boundaries of the switch fabric, I think non-blocking leaf/spine fabric should be sufficient there. Please correct me if'm missing something.

SoftGate, the Linux router where we use DPDK, is designed for North/South traffic, sitting on the border of the data center, so we don't expect RoCE traffic there, but again, please let me know if you see it differently.

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton