Comment by nichohel

Following up on Boaz Barak's comment quoted in this article, my best local model did get the answer to the kiwi problem correct when I changed the system prompt from "You are my helpful AI assistant." to "This is a math exam."