Comment

Comment by westurner

> minimize cost to converge upon sufficiently low error problem

Is this a convex optimization or non-convex optimization problem?

> Evals

Re: pytest-evals, mcpbr, agentevals, foundry-toolkit; and devtools-mcp; https://news.ycombinator.com/item?id=48532642

OpenInference and OpenTelemetry have a schema for agent sessions.

I finally discovered agentsview and ctxrs/ctx for indexing and searching agent session logs. Perhaps such an index is also useful for agent optimization

> Nonce

Accuracy is sensitive to nonce and temperature without variance in the model hyperparameters

parent westurner 3 months ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton