Comment by minimaxir

Tested it out a bit yesterday: it does work as advertised, and notably does work with image input: https://twitter.com/minimaxir/status/1776248424708612420

However, there is a rather concerning issue that even with a tool specified, the model tends to be polite and reply with "Here's the JSON you asked: <JSON>" which is objectively not what I want and aggressive prompt engineering to stop it from doing that has a lower success rate than I would like.