LLM inference can, with a bit of know-how, made 100% deterministic.

Of course tests need to be maintained. They have always been. And the test plan you write determines what and how it needs to be tested, just like it has always been.