Comment by Ldorigo

You can actually get just as good results for packaged food if you just allow the agent to use a web search tool & keep a growing local database of "known food items". I did the same for a while, but it was quite expensive (this was a while back with less powerful models and required a bit of orchestration to make it reliable)