cmar00
Joined 1 year ago
Joined 1 year ago
- Which tools did you use to create this ecosystem?
- Do you write the tests yourself? Do you tell it which tests to write? Or does it guess them on its own based on his understanding of your preferences? How do you make sure the generated code is secure?
- As you give orders to the orchestrator and as the orchestrator gives orders to sub agents your original message might get distorted (similar to when you print a copy of a copy of a copy with your printer). Do you ever find subagents going off topic in an endless code/review/code/review loop?
Regarding old API regression, I think that's because the LLM sees a lot more examples of deprecated APIs throughout the code, than new replacements you just introduced. You could try forcing it to immediately replace old calls to deprecated endpoints, then actually removing the definition completely, so that you reduce the number of bad examples and increase that of good examples
Before, we used to build a mental model of the code with every new line of code we wrote. That took time, but the result was a very solid understanding. Now we try to build the mental model by just looking at what the LLM produces. Similar to how students who spend most of their time practicing what they are studying with actual exercises achieve higher grades than those who just read the book, we are now at a disadvantage against our old selves who made the effort of writing the code.
Moreover, an LLM produces code a lot faster than we can read and understand. If we want to achieve an actual speedup in code output, there's no way we can read and understand everything and be faster than before. We have to sacrifice the understanding of some parts. This compounds over time and we quickly get into a place of total reliance on LLMs.
Regarding addiction: I also think these devices are addictive. They do open a lot of new doors for us builders. But I think hour grey matter hardware is not built of this speed. Give it time, the more project ideas you start spinning up, the sooner you'll reach burnout.
In the past few days I found out an interesting way to do a deck shuffle in O(1) space and time complexity. I think some of you might enjoy.
Let me know what you think :)