Dunning-Kruger theory of society

Lay theories of groups

January 20, 2022 — January 20, 2022

how do science
incentive mechanisms
Figure 1

A collection of notes on our known-terrible ability to know our terrible inability to know about others and ourselves. Was that hard to parse? What I mean is that we seem to reliably

  1. think we know more about how society works than we do in fact know, and
  2. fail to learn that we do not know how society works.

So, like the Dunning-Kruger theory of mind, but complicated by the fact that society is larger and even more confusing than individual minds.

Classic conspiracies are usually based on some Dunning-Kruger theorising. Weaponised social media works for this reason.

Figure 2

My bias is that I think we e.g. tend to underemphasise memetics in understanding society.

As discussed in opinion dynamics post, IMO opinions do not work the way we think they do. That is not because we are dumb per se, but because no matter how smart we are, humans naturally really terrible at reasoning about our own reasoning. I think of this as the Dunning-Kruger theory of mind. We are terrible are understanding how we ourselves think, and thus we are even worse and understanding how other people think, let alone whole societies full of other people. Recommended for a fun general introduction to the general topic of self delusion, see David McRaney’s You are not so smart (McRaney 2012), which has an excellent accompanying Podcast with some updated material.

tl;dr A sincerely-held personal conviction is what a socially transmitted belief feels like from the inside.

Self delusion leads us astray in many parts of life, and seeing through our own flimsy opinions is one of those parts. If I acquire an opinion from my social network, I am likely to wilfully ignore the original, for many self-deluded reasons. One is Belief Change Blindness (Wolfe and Williams 2018), which is a tendency to believe that we have always believed what we now believe. Another is that we are all naive realists, which is to say, we tend to overestimate how much facts and reasoning have influenced our beliefs.

Figure 3: St Anthony and the cognitive biases

This is how it can be that acquiring an opinion from someone else feels like having a sincerely held belief that I adopted from principles.

I am unlikely to notice acquiring this belief from someone else. Instead, I am likely to think I have always felt this way, and I am likely to think it is based on facts, even if none of those things are true. If taking on a belief through gossip and hearsay feels like adopting smart, evidence-led beliefs, is it any wonder that we underestimate how big an effect gossip and hearsay has? The truth is, we are all sheeple most of the time, me, you and the person at the bus stop.

It gets worse when we are required to reason at a big scale. People are demonstrably terrible at thinking through the implications of how opinions behave at large scales (Duncan J. Watts 2014). There are many experiments examining this — I quite like Salganik and Watts (2008) which is a large experiment where people were persuaded to like bands because experimenters manipulated the apparent popularity of their songs; At least in the short term, what is cool amongst your peers overwhelms what is good. When I put it that way, it sounds like I am saying something very obvious. But we behave as if making things cool was not how the world works, all the time, in political campaigning.

Writ large, Everything is Obvious (once you know the answer) is Duncan Watts’ laundry list of examples of how all our intuitions about how society works are self-justifying guesses divorced from evidence, except for his, because Yahoo let him build his own experimental online social networks.

So, if you are not an expert on this, however much you feel like social networks determine belief, add a little more on top of that because you are likely underestimating it.

TODO: mention bathtub dynamics problems also.

Social Desirability Bias: How Psych Can Salvage Econo-Cynicism

Social desirability bias is the tendency of respondents to answer questions in a manner that will be viewed favorably by others. It can take the form of over-reporting “good behavior” or under-reporting “bad,” or undesirable behavior. The tendency poses a serious problem with conducting research with self-reports, especially questionnaires. This bias interferes with the interpretation of average tendencies as well as individual differences.

Figure 4

1 References

Bai, Ramos, and Fiske. 2020. As Diversity Increases, People Paradoxically Perceive Social Groups as More Similar.” Proceedings of the National Academy of Sciences.
Belmi, and Laurin. 2016. Who wants to get to the top? Class and lay theories about power.” Journal of Personality and Social Psychology.
Broockman, and Kalla. 2016. Durably Reducing Transphobia: A Field Experiment on Door-to-Door Canvassing.” Science.
Carrell, Hoekstra, and West. 2015. The Impact of Intergroup Contact on Racial Attitudes and Revealed Preferences.” Working Paper 20940.
Chang, Milkman, Gromet, et al. 2019. The Mixed Effects of Online Diversity Training.” Proceedings of the National Academy of Sciences.
Farrell. 2012. The Consequences of the Internet for Politics.” Annual Review of Political Science.
Garip. 2020. What Failure to Predict Life Outcomes Can Teach Us.” Proceedings of the National Academy of Sciences.
Goel, Mason, and Watts. 2010. Real and Perceived Attitude Agreement in Social Networks.” Journal of Personality and Social Psychology.
Haslam, Bastian, Bain, et al. 2006. Psychological Essentialism, Implicit Theories, and Intergroup Relations.” Group Processes & Intergroup Relations.
Heck, Chabris, Watts, et al. 2020. Objecting to Experiments Even While Approving of the Policies or Treatments They Compare.” Proceedings of the National Academy of Sciences.
Lerman, Yan, and Wu. 2016. The ‘Majority Illusion’ in Social Networks.” PLOS ONE.
Levy, Chiu, and Hong. 2006. Lay Theories and Intergroup Relations.” Group Processes & Intergroup Relations.
McRaney. 2012. You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your Memory Is Mostly Fiction, an d 46 Other Ways You’re Deluding Yourself.
Murphy. 2020. Markets Against Modernity: Ecological Irrationality, Public and Private. Capitalist Thought : Studies in Philosophy, Politics, and Economics.
Newell, and Wasson. 2002. “Social System Vs Solar System: Why Policy Makers Need History.” In.
Rossman. 2012. Climbing the Charts: What Radio Airplay Tells Us about the Diffusion of Innovation.
Rossman, and Fisher. 2021. Network Hubs Cease to Be Influential in the Presence of Low Levels of Advertising.” Proceedings of the National Academy of Sciences.
Salganik, Dodds, and Watts. 2006. Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market.” Science.
Salganik, and Watts. 2008. Leading the Herd Astray: An Experimental Study of Self-Fulfilling Prophecies in an Artificial Cultural Market.” Social Psychology Quarterly.
Sommers, and Norton. 2006. Lay Theories About White Racists: What Constitutes Racism (and What Doesn’t).” Group Processes & Intergroup Relations.
Uscinski, and Atkinson. 2013. Why Do People Believe in Conspiracy Theories? The Role of Informational Cues and Predispositions.” SSRN Scholarly Paper ID 2268782.
Wagner-Egger, Delouvée, Gauvrit, et al. 2018. Creationism and conspiracism share a common teleological bias.” Current Biology.
Watts, Duncan J. 2011. Everything Is Obvious: Once You Know the Answer.
———. 2014. Common Sense and Sociological Explanations.” American Journal of Sociology.
Watts, Duncan J., and Dodds. 2007. Influentials, Networks, and Public Opinion Formation.” Journal of Consumer Research.
Watts, Duncan J., Rothschild, and Mobius. 2021. Measuring the News and Its Impact on Democracy.” Proceedings of the National Academy of Sciences.
Watts, Duncan J, and Strogatz. 1998. Collective Dynamics of ‘Small-World’ Networks.” Nature.
Wolfe, and Williams. 2018. Poor metacognitive awareness of belief change.” Quarterly Journal of Experimental Psychology (2006).
Zedelius, Müller, and Schooler. 2017. The Science of Lay Theories: How Beliefs Shape Our Cognition, Behavior, and Health.