LLMs are determistic. Just like everything else computers are capable of doing.

Commercial front-ends just hide the random seed parameters.

Distributed float math is not deterministic without introducing total operations ordering and destroying performance

It's not usefully deterministic in the way computers usually are. Sensitively identical input can still lead to wildly different outputs even if all randomness is crushed out.