The three properties mentioned, I think require full AGI, I will shorten them for this comment.
> It should consistently result in functionally correct code [...]
> It should accomplish [...] business requirements in natural language.
> It should allow the operator to modify the code without requiring knowledge of implementation [...]
These properties are exactly what current human software engineers are doing. It's why you hire someone and offload all the knowledge and responsibilities unto them. AI will have to match a human level intelligence, and when they do, since they already have all the knowledge on the Internet, it will basically be above AGI and closer to ASI.
My overall point here is that the current hype, and why there will probably be a market adjustment if not a bubble, is that people underestimate how hard it is to build this type of human intelligence. People are extrapolating from a very capable pattern matching system to something that has self-awareness, agency, and a sense of place in a world of humans.
> It should consistently result in functionally correct code [...]
> It should accomplish [...] business requirements in natural language.
> It should allow the operator to modify the code without requiring knowledge of implementation [...]
These properties are exactly what current human software engineers are doing. It's why you hire someone and offload all the knowledge and responsibilities unto them. AI will have to match a human level intelligence, and when they do, since they already have all the knowledge on the Internet, it will basically be above AGI and closer to ASI.
My overall point here is that the current hype, and why there will probably be a market adjustment if not a bubble, is that people underestimate how hard it is to build this type of human intelligence. People are extrapolating from a very capable pattern matching system to something that has self-awareness, agency, and a sense of place in a world of humans.