When people say they do not care what others think of them, for the most part they deceive themselves. Generally they mean only that they will do as they choose, in the confidence that no one will know their vagaries; and at the utmost only that they are willing to act contrary to the opinion of the majority because they are supported by the approval of their neighbours. It is not difficult to be unconventional in the eyes of the world when your unconventionality is but the convention of your set. It affords you then an inordinate amount of self-esteem. You have the self-satisfaction of courage without the inconvenience of danger. But the desire for approbation is perhaps the most deeply seated instinct of civilised man. No one runs so hurriedly to the cover of respectability as the unconventional woman who has exposed herself to the slings and arrows of outraged propriety. I do not believe the people who tell me they do not care a row of pins for the opinion of their fellows. It is the bravado of ignorance. They mean only that they do not fear reproaches for peccadillos which they are convinced none will discover.
But here was a man who sincerely did not mind what people thought of him, and so convention had no hold on him.
-- W. Somerset Maugham