Comment

Comment by randusername

Cost is the exception to how LLM learning curves have dropped off and in some ways rewarded late adopters. (e.g. prompt engineering is hardly worth the bother when the models now think so hard about user intent)

It continues to be an uphill battle to help people at $DAYJOB understand that the relationship between turns and cost is nonlinear. And many still don't understand the idea of a system prompt, that they can control how chatty all responses are.

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton