Comment
Comment by inferencecoder
I meant serious players often do serve on a single node. They can beat API pricing as well.
Multi-node can add gain, but also adds a lot of deployment complexity so its just not always possible or optimal.
Be the first to share your thoughts.