The important thing is to realize that this feeling is irrational. People aren't strongly bothered that easily. Quite the contrary, extroverted people tend to be much more popular than average.