I saw an llm bootstrapping and testing it's own harness and rewriting it's own system prompt. If that's not self improving then I dunno what is.

Can the thing enter into an runaway looop while improving the model itself -- probably not, not without us not noticing at least