I wear mine at the gym and sometimes to/from the gym as well. Why wait for them to become common? In what way are they not acceptable? I challenge anybody not to serve me at a restaurant, or allow me into their store, or kick me out of my place of work because of the shoes I've chosen. How absurd.
I do frequent high end restaurants and clubs. But not being "acceptable in society" leading to "never wearing them" is quite different from not being acceptable in a high end restaurant or club.