Comment Comment by belter Ask a model to"Write a chess engine where pawns move backward and kings can jump like nights"It will keep slipping back into real chess rules. It learned chess, it did not understand the concept of "rules"OrAsk it to reverse a made up word like"Reverse the string 'glorbix'"It will get it wrong on the first try. You would not fail.Or even better ask it to..."Use the dxastgraphx library to build a DAG scheduler."dxastgraphx is a non existing library...Marvel at the results...tried in both Claude and ChatGPT.... parent belter 10 months ago
"Write a chess engine where pawns move backward and kings can jump like nights"
It will keep slipping back into real chess rules. It learned chess, it did not understand the concept of "rules"
Or
Ask it to reverse a made up word like
"Reverse the string 'glorbix'"
It will get it wrong on the first try. You would not fail.
Or even better ask it to...
"Use the dxastgraphx library to build a DAG scheduler."
dxastgraphx is a non existing library...
Marvel at the results...tried in both Claude and ChatGPT....