Comment by Abimelex

Well it "works" only because LLMs have the context baked in. The problem is, that this context is something like world-knowledge. Defining the context you need for your exact problem, e.g. your company, will add so much more information that programming is probably the better way.