dcastm

What’s the context window?

Many people who enjoyed building and coding things are going through this right now, myself included.

In my case, I felt that I was pretty good at rapid product prototyping and had made that part of my identity. Then AI agents made it trivial. It took me some time to process and accept that reality. But I’m okay with it now. I simply had to move on.

After a while, I found two things that have helped:

1. Leaning into other areas where AI can boost my skills rather than just replace them, such as writing (for example, my last two posts made it to the front page of HN) and sales (leads, proposals, etc)

2. Taking on more ambitious projects. I used to think about side projects I could complete in days, and now I think more about projects I can complete in months. With AI, days have become hours and months have become days, so I simply try to think of projects that would have taken me a long time before.

What’s the context size?

That's not a fair read of what I said

I also found that interesting but our evaluation methodology is quite different, so I didn’t go too deep into it

It does, tbh I was also surprised by the results!

Thank you! Will take a look at your results.

I couldn't find much when I first looked into this, which is why I ended up writing the article.

Same for me. I actively ask the LLM to write as few tests as possible. Otherwise you end up redundant and low value ttests.