That's a good point. It seems to be very difficult for mathematicians to formulate their thoughts in a non-formal manner. When they try to, it's almost like they speak in a learned second language.
That said, mathematics is not really bound by any type of "reality" either, whereas other fields, even physics, certainly are.
A little more reality in math and a little more abstraction in the rest would probably help.