Comment by getcrunk

Is it just me or is it really hard to get a complete/working product out of an llm?

I find that unless I have very detailed specs with rigorous completion verification/criteria (manually atm) or tests. It’s like 60/40 at best.

And adding all the tricks only gets me to like 75-80.

Tbh I am using cheaper Chinese models (ds4.1f) and only pay for the $20 plans from the us labs