I've seen some newer testing frameworks where you prompt for the outcome you want under a specific scenario. The first run is a LLM agent that figures out the steps but those steps are then used for recurring runs. If something fails, it goes back to the agent loop to see if it's an actual error.
This works well in e2e type tests where the test implementation might change but the customer experience hasn't.
So maybe there is a hybrid approach in our future.
This works well in e2e type tests where the test implementation might change but the customer experience hasn't.
So maybe there is a hybrid approach in our future.