Comment by gavinray

  > Self-improving code would be code that runs itself and improves itself.

I don't find the description any less accurate than saying that a JIT'ed application is self-improving code.