Comment by varun_ch

genuine question: is latency that big of a deal wrt tools for agents? I see this a lot with these AI-native tooling replacement projects, but surely the inference will be orders of magnitudes slower?