Technically true, but this is a very inefficient optimization strategy and usually indicates some structural issue with your setup.
When you know enough about the JSON structure to understand how to set a decoding order, then you can simply break the problem into smaller parts so it's more manageable.
Otherwise, you have these solutions:
- GEPA-style prompt optimization for simple agents
- If working with large models, you can just have them do step-by-step problem solving & relying on their CoT for accuracy.
- A small model can simply be trained to do what you want
And if those don't work, I would be extremely surprised.
When you know enough about the JSON structure to understand how to set a decoding order, then you can simply break the problem into smaller parts so it's more manageable.
Otherwise, you have these solutions: - GEPA-style prompt optimization for simple agents - If working with large models, you can just have them do step-by-step problem solving & relying on their CoT for accuracy. - A small model can simply be trained to do what you want
And if those don't work, I would be extremely surprised.