Comment by ozereray1

Edge and local inference completely strip away the infinite scaling safety net of cloud backends. When compute and memory are heavily constrained, runtime governance cannot afford any heavy control-plane overhead.