AI often simply does not offer the best options, does not think strategically, and if you constrained to its choices you will often make silly mistakes.
This is why all the arguments about context windows and RAG exist, because at the end of the day even if you asked the question of a human with all the context there's such a thing as opinions, stated vs unstated goals, requirements vs non functional requirements, etc which will give you wildly different answers.
Most of the time people don't even know the questions they want to ask.
This is why all the arguments about context windows and RAG exist, because at the end of the day even if you asked the question of a human with all the context there's such a thing as opinions, stated vs unstated goals, requirements vs non functional requirements, etc which will give you wildly different answers.
Most of the time people don't even know the questions they want to ask.