tempusalaria
Joined 4 years ago
Joined 4 years ago
1) low latency desired, long user prompt 2) function runs many parallel requests, but is not fired with common prefix very often. OpenAI was very inconsistent about properly caching the prefix for use across all requests, but with Anthropic it’s very easy to pre-fire
Indeed in seems in most language model RL there is not even process supervision, so a long way from NTP
Strategy matters a lot and good strategy is worth at least a few positions in a race.
Insta was a huge hit for sure but since then Meta Capital allocation has been a disaster including a lot of badly timed buybacks
In fact it’s a great illustration of why the hype around agents is misplaced!
Finally, saying that agents can have predictable behavior is wrong (except on simple tasks where you shouldn’t be using an agent anyway). Agents loop and compound their input, making them highly non-deterministic even for the same prompt.
In the long run the definition used by OpenAI, Anthropic et al will win out so can we just all switch to that?