There are basically two kinds of applications. One is where you want to correctly solve the problem at least 99 out of 100 times. LLMs generally don't (and not everybody realizes that) so there are a lot of debates and research around how useful and reliable they are or how to make them so.

The other kind of application is where you can try 100 times and you only need to be right once. Solving a mathematical research problem is like that.