Comment

Comment by Solomet

Newest LLM writing tell: Concepts are described in terms normally more appropriate for physical object.

> A lab that suppresses it in a frontier model just moves the advantage to open models that still _carry_ it

> they carry no signal about which is better

> where your workload _sits_ on that frontier should pick the point

> and no model _sits_ in the judge’s seat

> every ratio _sits_ at 0.99–1.10

Many many more examples of "sit"

> Every comparison in this post "holds" the questions

I have been seeing this a lot in my recent work with LLMs and it is quite frustrating. Even more frustrating is how frequently it uses low-signal terms for things unnecessarily. These 'physical object' terms are one example but at times it really seems that they 'preserve effort' by choosing a less descriptive term because it 'fits'

I have also caught it replacing descriptive terms with more vague ones for no discernible reason other than laziness.

"Minimize ambiguity" has been my go-to instruction as of late when the agent drifts back towards vague terms and lack of specificity.

parent Solomet 1 month ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton