"What others think of you is none of your business."
Deepak Chopra first said it as written. Since he put it so eloquently, many others from spiritual leaders like Joel Osteen to pop singers like Lana del Rey to little-known bloggers such as myself have echoed the same sentiments, either verbatim or in paraphrase.
Yes, sometimes people's opinions of you actually get back to you on paper, in sound bytes or in personal conversation - sometimes it's flattering, sometimes it's unflattering and other times it's just plain malicious. The latter two are usually the hardest to shake away but regardless of what the opinion is, it's actually none of your concern.
The only opinions that truly matter are your own - as long as you can look yourself in the mirror and feel that you and the God that you serve are pleased with you and what you do, everyone else's opinions are just... white noise.