Comment

Comment by mkatx

I would say, try without thinking on. I find reasoning on any rag type request seems to increase hallucinations, probably due to the thinking tokens taking attention away from the, in this case, vision tokens.

I'd recommend non-thinking for any non-prompt input, and leave the thinking where it has to actually reason.

parent mkatx 2 months ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton