Comment

Comment by zhixuan

At scale, if something can go wrong with a model, it will. Earlier this year, we ran into a strange issue. On certain inputs, Gemini 3 Flash would loop in its own reasoning, burn 16k tokens each turn, and produce nothing. The failure was deterministic, so retries just multiplied the cost. We got 92% recovery by telling the model what happened and asking it to try again.
parent zhixuan 2 months ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton