Even with that paragraph, I still interpret the essay as deflationary. Even though the stone has some role to play (as a social trigger), it’s materially different than the carrots, onions, etc. (which provide actual nutrition and flavor). We can draw clear distinctions. The question is whether this difference-in-kind is real in the case of AIs.
I’d respond the same way to your hamburger vs. steak analogy. Sure, sometimes the LLM gives us a fine burger and not a steak, and it’s best for us to have the right attitude in that case.
But if LLM’s can produce “steaks” (that is, whatever talented humans do) in the imminent future, that has _enormous practical impact_.
I’d respond the same way to your hamburger vs. steak analogy. Sure, sometimes the LLM gives us a fine burger and not a steak, and it’s best for us to have the right attitude in that case.
But if LLM’s can produce “steaks” (that is, whatever talented humans do) in the imminent future, that has _enormous practical impact_.