Comment by lkbm

We shouldn't use an LLM because...LLMs never improve?

This seems like a great source for domain-specific RL, but even without that, we can expect there to be higher-quality LLMs that can be trivially swapped in within a year, if not a week.