I have done some experiments with telling ChatGPT it's an AI software engineer writing a Node.js program and it's talking to a special command interpreter that understands things like INSTALL_PACKAGE and UPDATE_FILE, then executing it's commands automatically and feeding the output back in. It was fascinating watching it try to complete a programming task, searching for appropriate modules, reading the docs, etc. But it seemed to get a bit overwhelmed and started alternating between listing files and editing the devnotes.md with it's plan. For some really simple tasks though it was able to complete them fully autonomously.
What actually worked better was just making a list of prompts and filenames in a JSON file and automatically giving each one to it and saving the results one after another. Then improving those specs after looking at the output. By being very specific, making sure that things like names and endpoints matched in each prompt, and adding a few hints, I was able to get it to complete a full working program with multiple HTML/JS pages and an Express.js server script.
Next experiment is to get it to output the spec.json based on another less technical one that doesn't have the file breakdown or technical details.
What actually worked better was just making a list of prompts and filenames in a JSON file and automatically giving each one to it and saving the results one after another. Then improving those specs after looking at the output. By being very specific, making sure that things like names and endpoints matched in each prompt, and adding a few hints, I was able to get it to complete a full working program with multiple HTML/JS pages and an Express.js server script.
Next experiment is to get it to output the spec.json based on another less technical one that doesn't have the file breakdown or technical details.