Constructive-Indian answers “Why do intelligent people withdraw from society?” on Quora:
https://qr.ae/pKKCX7

All societies prefer platitudes over truth, vagaries over precision, superficiality over depth, and show over substance.

This is to say that we have not yet evolved as a species to have our social mob bear natural predilection to truth, precision, depth, and substance.

A social group, anywhere in the world today, mistakes:

authority for intelligence,
money for success,
expressed feelings for argument,
logic for insensitivity,
religion for science,
regurgitation for thought,
luck for hard work,
ordinary for the important,
managers/bureaucrats for leaders, and
buying patents for invention.
Since a lot of these traits are important for any person who is truly intelligent, they remain aloof from most social groups or individuals in any society and prefer to have a small or no circle around them.

Adding to this is the burden of the crab mentality. Most social groups or individuals do not like to see an intelligent person near them. They would much rather have the person excommunicated than be used to make them improve.

Though this is slightly less in some of the post-Industrialized societies, where people have learned that collaborating with an intelligent person is a much better deal in terms of making profits or improving their lives, this is not the case in many developing or under-developed, yet to be industrialized societies.

It is for these reasons that many truly intelligent individuals prefer to remain aloof.