A collection of notes on our known-terrible ability to know our terrible inability to know about others and ourselves.
Was that hard to parse?
What I mean is that we seem to reliably
- think we know more about how society works than we do in fact know, and
- fail to learn that we do not know how society works.
So, like the Dunning-Kruger theory of mind, but complicated by the fact that society is larger and even more confusing than individual minds.
Classic conspiracies are usually based on some Dunning-Kruger theorising.
Weaponised social media works for this reason.
My bias is that I think we e.g. tend to underemphasise memetics in understanding society.
As discussed in opinion dynamics post,
IMO opinions do not work the way we think they do.
That is not because we are dumb per se, but because no matter how smart we are, humans naturally really terrible at reasoning about our own reasoning.
I think of this as the Dunning-Kruger theory of mind.
We are terrible are understanding how we ourselves think, and thus we are even worse and understanding how other people think, let alone whole societies full of other people.
Recommended for a fun general introduction to the general topic of self delusion, see David McRaney’s You are not so smart (McRaney 2012), which has an excellent accompanying Podcast with some updated material.
tl;dr A sincerely-held personal conviction is what a socially transmitted belief feels like from the inside.
Self delusion leads us astray in many parts of life, and seeing through our own flimsy opinions is one of those parts.
If I acquire an opinion from my social network, I am likely to wilfully ignore the original, for many self-deluded reasons.
One is Belief Change Blindness (Wolfe and Williams 2018), which is a tendency to believe that we have always believed what we now believe.
Another is that we are all naive realists, which is to say, we tend to overestimate how much facts and reasoning have influenced our beliefs.
St Anthony and the cognitive biases
This is how it can be that acquiring an opinion from someone else feels like having a sincerely held belief that I adopted from principles.
I am unlikely to notice acquiring this belief from someone else.
Instead, I am likely to think I have always felt this way, and I am likely to think it is based on facts, even if none of those things are true.
If taking on a belief through gossip and hearsay feels like adopting smart, evidence-led beliefs, is it any wonder that we underestimate how big an effect gossip and hearsay has?
The truth is, we are all sheeple most of the time, me, you and the person at the bus stop.
It gets worse when we are required to reason at a big scale.
People are demonstrably terrible at thinking through the implications of how opinions behave at large scales (Duncan J. Watts 2014).
There are many experiments examining this — I quite like Salganik and Watts (2008) which is a large experiment where people were persuaded to like bands because experimenters manipulated the apparent popularity of their songs; At least in the short term, what is cool amongst your peers overwhelms what is good.
When I put it that way, it sounds like I am saying something very obvious.
But we behave as if making things cool was not how the world works, all the time, in political campaigning.
Everything is Obvious (once you know the answer)
is Duncan Watts’ laundry list of examples of how all our intuitions about how
society works are self-justifying guesses divorced from evidence,
except for his, because Yahoo let him build his own experimental online
So, if you are not an expert on this, however much you feel like social networks determine belief, add a little more on top of that because you are likely underestimating it.
TODO: mention bathtub dynamics problems also.
Social Desirability Bias: How Psych Can Salvage Econo-Cynicism
Social desirability bias is the tendency of respondents to
answer questions in a manner that will be viewed favorably by others. It
can take the form of over-reporting “good behavior” or under-reporting
“bad,” or undesirable behavior. The tendency poses a serious problem
with conducting research with self-reports, especially questionnaires.
This bias interferes with the interpretation of average tendencies as
well as individual differences.
Bai, Xuechunzi, Miguel R. Ramos, and Susan T. Fiske. 2020. “As Diversity Increases, People Paradoxically Perceive Social Groups as More Similar.” Proceedings of the National Academy of Sciences
117 (23): 12741–49.
Belmi, Peter, and Kristin Laurin. 2016. “Who wants to get to the top? Class and lay theories about power.” Journal of Personality and Social Psychology
111 (4): 505–29.
Carrell, Scott E., Mark Hoekstra, and James E. West. 2015. “The Impact of Intergroup Contact on Racial Attitudes and Revealed Preferences.”
Working Paper 20940. National Bureau of Economic Research.
Chang, Edward H., Katherine L. Milkman, Dena M. Gromet, Robert W. Rebele, Cade Massey, Angela L. Duckworth, and Adam M. Grant. 2019. “The Mixed Effects of Online Diversity Training.” Proceedings of the National Academy of Sciences
116 (16): 7778–83.
Farrell, Henry. 2012. “The Consequences of the Internet for Politics.” Annual Review of Political Science
15 (1): 35–52.
Garip, Filiz. 2020. “What Failure to Predict Life Outcomes Can Teach Us.” Proceedings of the National Academy of Sciences
117 (15): 8234–35.
Goel, Sharad, Winter Mason, and Duncan J. Watts. 2010. “Real and Perceived Attitude Agreement in Social Networks.” Journal of Personality and Social Psychology
99 (4): 611–21.
Haslam, Nick, Brock Bastian, Paul Bain, and Yoshihisa Kashima. 2006. “Psychological Essentialism, Implicit Theories, and Intergroup Relations.” Group Processes & Intergroup Relations
9 (1): 63–76.
Heck, Patrick R., Christopher F. Chabris, Duncan J. Watts, and Michelle N. Meyer. 2020. “Objecting to Experiments Even While Approving of the Policies or Treatments They Compare.” Proceedings of the National Academy of Sciences
117 (32): 18948–50.
Lerman, Kristina, Xiaoran Yan, and Xin-Zeng Wu. 2016. “The ‘Majority Illusion’ in Social Networks.” PLOS ONE
11 (2): e0147617.
Levy, Sheri R., Chi-yue Chiu, and Ying-yi Hong. 2006. “Lay Theories and Intergroup Relations.” Group Processes & Intergroup Relations
9 (1): 5–24.
McRaney, David. 2012. You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your Memory Is Mostly Fiction, an d 46 Other Ways You’re Deluding Yourself. Reprint edition. New York: Avery.
Murphy, Ryan H. 2020. Markets Against Modernity: Ecological Irrationality, Public and Private. Capitalist Thought : Studies in Philosophy, Politics, and Economics. Lanham, Maryland: Lexington Books.
Newell, Barry, and Robert Wasson. 2002. “Social System Vs Solar System: Why Policy Makers Need History.” In. Grenoble.
Rossman, Gabriel. 2012. Climbing the Charts: What Radio Airplay Tells Us about the Diffusion of Innovation. Princeton: Princeton University Press.
Rossman, Gabriel, and Jacob C. Fisher. 2021. “Network Hubs Cease to Be Influential in the Presence of Low Levels of Advertising.” Proceedings of the National Academy of Sciences
Salganik, Matthew J., Peter Sheridan Dodds, and Duncan J. Watts. 2006. “Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market.” Science
311 (5762): 854–56.
Sommers, Samuel R., and Michael I. Norton. 2006. “Lay Theories About White Racists: What Constitutes Racism (and What Doesn’t).” Group Processes & Intergroup Relations
9 (1): 117–38.
Uscinski, Joseph E., and Matthew Atkinson. 2013. “Why Do People Believe in Conspiracy Theories? The Role of Informational Cues and Predispositions.”
SSRN Scholarly Paper ID 2268782. Rochester, NY: Social Science Research Network.
Wagner-Egger, Pascal, Sylvain Delouvée, Nicolas Gauvrit, and Sebastian Dieguez. 2018. “Creationism and conspiracism share a common teleological bias.” Current Biology
28 (16): R867–68.
Watts, Duncan J. 2011. Everything Is Obvious: Once You Know the Answer. 1st ed. New York: Crown Business.
———. 2014. “Common Sense and Sociological Explanations.” American Journal of Sociology
120 (2): 313–51.
Watts, Duncan J., and Peter Sheridan Dodds. 2007. “Influentials, Networks, and Public Opinion Formation.” Journal of Consumer Research
34 (4): 441–58.
Watts, Duncan J., David M. Rothschild, and Markus Mobius. 2021. “Measuring the News and Its Impact on Democracy.” Proceedings of the National Academy of Sciences
Watts, Duncan J, and Steven H Strogatz. 1998. “Collective Dynamics of ‘Small-World’ Networks.” Nature
393 (6684): 440–42.
Wolfe, Michael B., and Todd J. Williams. 2018. “Poor metacognitive awareness of belief change.” Quarterly Journal of Experimental Psychology (2006)
71 (9): 1898–1910.
Zedelius, Claire M., Barbara C. N. Müller, and Jonathan W. Schooler. 2017. The Science of Lay Theories: How Beliefs Shape Our Cognition, Behavior, and Health. Springer.