Comment by avaku

There is definitely a ceiling problem. However, I found that with smarter models (such as o3) you could first discuss the mathematical model (or system architecture), so that it knows the context. After that you can ask it to write code, and then it can follow your overall idea very well. Even write a working ML algorithm with fitting. That's why I made the blog post, because I was able to achieve the next level of collaboration with o3. It almost shocks me how good is this. Since the blog post, I've made significant advances in other work-related areas (ML algos for finance).