I'm trying to gather the paperwork to apply for citizenship in another country. I gave Opus 5.5 everything I've assembled so far (PDFs, PNGs of birth/death certificates, etc.) and asked it for next steps and it:
* Got the answer wrong, because it neglected to search for or take into account a new law passed a few years ago.
* Missed obvious things in the provided documents, such as names and dates.
* Gave contradictory information, e.g. telling me that one step might not be ready for a year, but that I should get some things done now because they expire six months after they're released. It neglected to make the connection that if I can't start something for a year, then it would be pointless to start getting paperwork ready for that thing right now if the paperwork expires in 6 months.
I use AI coding tools a lot. I thought this would be a slam dunk for agents in 2026 and it was worse than useless.
* Got the answer wrong, because it neglected to search for or take into account a new law passed a few years ago.
* Missed obvious things in the provided documents, such as names and dates.
* Gave contradictory information, e.g. telling me that one step might not be ready for a year, but that I should get some things done now because they expire six months after they're released. It neglected to make the connection that if I can't start something for a year, then it would be pointless to start getting paperwork ready for that thing right now if the paperwork expires in 6 months.
I use AI coding tools a lot. I thought this would be a slam dunk for agents in 2026 and it was worse than useless.