Great summary of the current state of AI coding, without all the hype.
I wonder though if we are fundamentally limited by LLMs architecture to come up with some novel architecture. Or is it just a limitation of current prompting and tools?
E.g. could your brute force the problem by asking "come up with 100 innovative, not yet tried ideas in compiler architecture" and run 100s of this experiments.
I feel like the answer to that is basically that "spark" that we have as human intelligence, but also... sometimes you get it by trying and failing many many times.
I wonder though if we are fundamentally limited by LLMs architecture to come up with some novel architecture. Or is it just a limitation of current prompting and tools?
E.g. could your brute force the problem by asking "come up with 100 innovative, not yet tried ideas in compiler architecture" and run 100s of this experiments.
I feel like the answer to that is basically that "spark" that we have as human intelligence, but also... sometimes you get it by trying and failing many many times.