Groupthink and the wisdom of crowds

2019-09-22 – 2021-07-05
Maybe related 🤷:

To link to: getting along, swarm sensing, voting systems, democracy, groupthink. 🏗 When do group decisions embody the wisdom of crowds and when groupthink?

Diversity dividends

Possibly diversity and tolerance is not just an intrinsic moral good, but may pay literal dividends in terms of avoiding groupthink and being ore effective etc. What are the conditions for this happy state?

Does diversity help attain wisdom? Sometimes, it seems. Scott Page calls this the diversity dividend. Quantifying when and how it works is of interest to me.

Practically, see cultivating diversity.

McKinsey report, Vivian Hunt, Dennis Layton, and Sara Prince: Why diversity matters:

While correlation does not equal causation (greater gender and ethnic diversity in corporate leadership doesn’t automatically translate into more profit), the correlation does indicate that when companies commit themselves to diverse leadership, they are more successful.

(They could possibly have done better than that mealy-mouthed correlation phrasing, via causal analysis.)

Other random readings: Chris Dillow, diversity trumps ability.

The new Matthew Syed book (Syed 2020) (titled Rebel Ideas or Superteams depending where you are) apparently covers some of this material.

Contrarianism

Scott Aaronson on “armchair epidemiology” uses the COVID-19 public communication fiasco as a lense on societal collective knowledge and science and the role of contrarians. Connection to red queen signal dynamics should be apparent. The comment threads in that post meander around this topic at length.

Scott Alexander, Contrarians, Crackpots, and Consensus tries to crack this one open with an ontology.

I think a lot of things are getting obscured by the term “scientific establishment” or “scientific consensus”. Imagine a pyramid with the following levels from top to bottom:

FIRST, specialist researchers in a field…

SECOND, non-specialist researchers in a broader field…

THIRD, the organs and administrators of a field who help set guidelines…

FOURTH, science journalism, meaning everyone from the science reporters at the New York Times to the guys writing books with titles like The Antidepressant Wars to random bloggers…

ALSO FOURTH IN A DIFFERENT COLUMN OF THE PYRAMID BECAUSE THIS IS A HYBRID GREEK PYRAMID THAT HAS COLUMNS, “fieldworkers”, aka the professionals we charge with putting the research into practice. … FIFTH, the general public.

A lot of these issues make a lot more sense in terms of different theories going on at the same time on different levels of the pyramid. I get the impression that in the 1990s, the specialist researchers, the non-specialist researchers, and the organs and administrators were all pretty responsible about saying that the serotonin theory was just a theory and only represented one facet of the multifaceted disease of depression. Science journalists and prescribing psychiatrists were less responsible about this, and so the general public may well have ended up with an inaccurate picture.

This resembles another pyramid of fashionable disagreement that he mentions, the Intellectual Hipsters and Meta-Contrarianism pyramid.

Rex Douglass’s How to be Curious Instead of Contrarian About COVID-19 dive into the Richard Epstein contrarian piece about COVID-19 response as a case study in how to disagree productively.

How should non-epidemiologists publicly discuss COVID-19 data and models? When leaders and citizens are especially sensitive to signals on public health, what is our intellectual responsibility to defer to the analysis of more expert speakers? I argue that our responsibility during crisis is the same as it was before; to do good work, to the best of our abilities, with the scientific principles of curiosity and honesty. Alternative shorthands like ‘staying in your lane’ are a poor decision rule for sorting good work from bad, and they ignore the very messy process that underlies real-world scientific inquiry. Lane-keeping is a poor way to learn and become a better consumer of expert findings, and gate-keeping is a missed opportunity to provide the public goods of feedback and review. To demonstrate the point, this note provides a detailed review of a recent piece “Coronavirus Perspective” (Epstein 2020a). By applying and illustrating data science principles point for point to this non-epidemiological take on epidemiological questions, it is hoped that the reader will take away not why they should avoid working on new topics but rather how they should approach those topics in an honest, curious, and rigorous way.

Incoming

References

Acemoglu, Daron, Victor Chernozhukov, and Muhamet Yildiz. 2006. “Learning and Disagreement in an Uncertain World.” Working Paper 12648. National Bureau of Economic Research. https://doi.org/10.3386/w12648.
Acemoglu, Daron, and Asuman Ozdaglar. 2011. “Opinion Dynamics and Learning in Social Networks.” Dynamic Games and Applications 1 (1): 3–49. https://doi.org/10.1007/s13235-010-0004-1.
Aleta, Alberto, and Yamir Moreno. 2019. “The Dynamics of Collective Social Behavior in a Crowd Controlled Game.” EPJ Data Science 8 (1): 1–16. https://doi.org/10.1140/epjds/s13688-019-0200-1.
Almaatouq, Abdullah, M. Amin Rahimian, Jason W. Burton, and Abdulla Alhajri. 2021. “When Social Influence Promotes the Wisdom of Crowds.” arXiv:2006.12471 [physics, Stat], April. http://arxiv.org/abs/2006.12471.
Atanasov, Pavel, Philip Rescober, Eric Stone, Samuel A Swift, Emile Servan-Schreiber, Philip E. Tetlock, Lyle Ungar, and Barbara Mellers. 2015. “Distilling the Wisdom of Crowds: Prediction Markets Versus Prediction Polls.” Academy of Management Proceedings 2015 (1): 15192. https://doi.org/10.1287/mnsc.2015.2374.
Banerjee, Abhijit V. 1992. “A Simple Model of Herd Behavior*.” The Quarterly Journal of Economics 107 (3): 797–817. https://doi.org/10.2307/2118364.
Baron, Robert S. 2005. “So Right It’s Wrong: Groupthink and the Ubiquitous Nature of Polarized Group Decision Making.” In Advances in Experimental Social Psychology, 37:219–53. Academic Press. https://doi.org/10.1016/S0065-2601(05)37004-3.
Brewer, Marilynn B. 1993. “Social Identity, Distinctiveness, and In-Group Homogeneity.” Social Cognition 11 (1): 150–64. https://doi.org/10.1521/soco.1993.11.1.150.
Danan, Eric, Thibault Gajdos, Brian Hill, and Jean-Marc Tallon. 2016. “Robust Social Decisions.” American Economic Review 106 (9): 2407–25. https://doi.org/10.1257/aer.20150678.
Dinesen, Peter Thisted, and Kim Mannemar Sønderskov. 2013. “Ethnic Diversity and Social Trust: The Role of Exposure in the Micro-Context.” Ethnic Diversity and Social Capital. http://curis.ku.dk/ws/files/46107631/Dinesen_S_nderskov_Ethnic_Diversity_and_Social_Trust_The_Role_of_Exposure_in_the_Micro_Context_May_2013.pdf.
Farrell, Henry, and Cosma Rohilla Shalizi. 2015. “Pursuing Cognitive Democracy.” From Voice to Influence: Understanding Citizenship in a Digital Age; Allen, D., Light, J., Eds, 211–31. http://henryfarrell.net/wp/wp-content/uploads/2013/04/Farrell-paper.pdf.
Fu, Feng, and Long Wang. 2008. “Coevolutionary Dynamics of Opinions and Networks: From Diversity to Uniformity.” Physical Review E 78 (1): 016104. https://doi.org/10.1103/PhysRevE.78.016104.
Garip, Filiz. 2020. “What Failure to Predict Life Outcomes Can Teach Us.” Proceedings of the National Academy of Sciences 117 (15): 8234–35. https://doi.org/10.1073/pnas.2003390117.
Golub, Benjamin, and Matthew O. Jackson. 2010. “Naïve Learning in Social Networks and the Wisdom of Crowds.” American Economic Journal: Microeconomics 2 (1): 112–49. https://doi.org/10.1257/mic.2.1.112.
———. 2011. “Network Structure and the Speed of Learning: Measuring Homophily Based on Its Consequences.” SSRN Scholarly Paper ID 1784542. Rochester, NY: Social Science Research Network. https://doi.org/10.2139/ssrn.1784542.
———. 2012. “How Homophily Affects the Speed of Learning and Best-Response Dynamics.” The Quarterly Journal of Economics 127 (3): 1287–1338. https://doi.org/10.1093/qje/qjs021.
Haghtalab, Nika, Matthew O. Jackson, and Ariel Procaccia. 2020. “Belief Polarization in a Complex World: A Learning Theory Perspective.” SSRN Scholarly Paper ID 3606003. Rochester, NY: Social Science Research Network. https://doi.org/10.2139/ssrn.3606003.
Hong, Lu, and Scott E. Page. 2004. “Groups of Diverse Problem Solvers Can Outperform Groups of High-Ability Problem Solvers.” Proceedings of the National Academy of Sciences 101 (46): 16385–89. https://doi.org/10.1073/pnas.0403723101.
Horwitz, Sujin K., and Irwin B. Horwitz. 2007. “The Effects of Team Diversity on Team Outcomes: A Meta-Analytic Review of Team Demography.” Journal of Management 33 (6): 987–1015. https://doi.org/10.1177/0149206307308587.
Jackson, Matthew O. 2009. “Social Structure, Segregation, and Economic Behavior.” Presented as the Nancy Schwartz Memorial Lecture, February. https://doi.org/10.2139/ssrn.1530885.
Jeppesen, Lars Bo, and Karim R. Lakhani. 2010. “Marginality and Problem-Solving Effectiveness in Broadcast Search.” Organization Science 21 (5): 1016–33. https://doi.org/10.1287/orsc.1090.0491.
Johnson, N. F., N. Velasquez, N. Johnson Restrepo, R. Leahy, R. Sear, N. Gabriel, H. Larson, and Y. Lupu. 2021. “Mainstreaming of Conspiracy Theories and Misinformation,” February. https://arxiv.org/abs/2102.02382v1.
Klug, Michael, and James P. Bagrow. 2016. “Understanding the Group Dynamics and Success of Teams.” Royal Society Open Science 3 (4). https://doi.org/10.1098/rsos.160007.
Kong, Yuqing. 2019. “Dominantly Truthful Multi-Task Peer Prediction with a Constant Number of Tasks.” arXiv:1911.00272 [cs, Econ], November. http://arxiv.org/abs/1911.00272.
Lalitha, Anusha, Tara Javidi, and Anand Sarwate. 2014. “Social Learning and Distributed Hypothesis Testing.” arXiv:1410.4307 [cs, Math, Stat], October. http://arxiv.org/abs/1410.4307.
Lee, Neil, and Max Nathan. 2011. “Does Cultural Diversity Help Innovation in Cities: Evidence from London Firms.” LSE Research Online Documents on Economics. London School of Economics and Political Science, LSE Library. https://econpapers.repec.org/paper/ehllserod/33579.htm.
List, Christian, and Robert E. Goodin. 2001. “Epistemic Democracy: Generalizing the Condorcet Jury Theorem.” Journal of Political Philosophy 9 (3): 277–306. https://doi.org/10.1111/1467-9760.00128.
Lorenz, Jan. 2010. “Heterogeneous Bounds of Confidence: Meet, Discuss and Find Consensus!” Complexity 15 (4): 43–52. https://doi.org/10.1002/cplx.20295.
Lublin, Joann S. 2015. “New Report Finds a ‘Diversity Dividend’ at Work.” WSJ (blog). January 20, 2015. https://blogs.wsj.com/atwork/2015/01/20/new-report-finds-a-diversity-dividend-at-work/.
Mahmoodi, Ali, Dan Bang, Karsten Olsen, Yuanyuan Aimee Zhao, Zhenhao Shi, Kristina Broberg, Shervin Safavi, et al. 2015. “Equality Bias Impairs Collective Decision-Making Across Cultures.” Proceedings of the National Academy of Sciences 112 (12): 3835–40. https://doi.org/10.1073/pnas.1421692112.
Mann, Richard P., and Dirk Helbing. 2016. “Minorities Report: Optimal Incentives for Collective Intelligence.” arXiv:1611.03899 [cs, Math, Stat], November. http://arxiv.org/abs/1611.03899.
Masuda, N, and S Redner. 2011. “Can Partisan Voting Lead to Truth?” Journal of Statistical Mechanics: Theory and Experiment 2011: –02002.
Moussaïd, Mehdi, Juliane E. Kämmer, Pantelis P. Analytis, and Hansjörg Neth. 2013. “Social Influence and the Collective Dynamics of Opinion Formation.” PLoS ONE 8 (11): e78433. https://doi.org/10.1371/journal.pone.0078433.
O’Connor, Cailin, and Jingyi Wu. 2021. “How Should We Promote Transient Diversity in Science?” MetaArXiv. https://doi.org/10.31222/osf.io/w3xc5.
Olfati-Saber, R., J.A. Fax, and R.M. Murray. 2007. “Consensus and Cooperation in Networked Multi-Agent Systems.” Proceedings of the IEEE 95 (1): 215–33. https://doi.org/10.1109/JPROC.2006.887293.
Page, Scott E. 2008. The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies - New Edition. New edition with a New preface by the author. Princeton, NJ: Princeton University Press.
———. 2011. Diversity and Complexity. Primers in Complex Systems. Princeton, NJ: Princeton University Press.
Peter Skerry. 2002. “Beyond Sushiology: Does Diversity Work?” Brookings Institution (blog). December 1, 2002. https://www.brookings.edu/articles/beyond-sushiology-does-diversity-work/.
Peters, Ole, and Alexander Adamou. 2015. “An Evolutionary Advantage of Cooperation.” arXiv:1506.03414 [nlin, q-Bio, q-Fin], June. http://arxiv.org/abs/1506.03414.
Prelec, Dražen, H. Sebastian Seung, and John McCoy. 2017. “A Solution to the Single-Question Crowd Wisdom Problem.” Nature 541 (7638): 532–35. https://doi.org/10.1038/nature21054.
Ren, W, and R W Beard. 2005. “Consensus Seeking in Multiagent Systems Under Dynamically Changing Interaction Topologies.” Automatic Control, IEEE Transactions on 50 (5): 655–61.
Syed, Matthew. 2020. Rebel Ideas: The Power of Diverse Thinking. S.l.: John Murray.
Trouche, Emmanuel, Emmanuel Sander, and Hugo Mercier. 2014. “Arguments, More Than Confidence, Explain the Good Performance of Reasoning Groups.” SSRN Scholarly Paper ID 2431710. Rochester, NY: Social Science Research Network. http://papers.ssrn.com/abstract=2431710.
Van den Steen, Eric. 2010. “Culture Clash: The Costs and Benefits of Homogeneity.” Management Science 56 (10): 1718–38. https://doi.org/10.1287/mnsc.1100.1214.
Weisbuch, Gérard, Guillaume Deffuant, Frédéric Amblard, and Jean-Pierre Nadal. 2002. “Meet, Discuss, and Segregate!” Complexity 7 (3): 55–63. https://doi.org/10.1002/cplx.10031.

No comments yet. Why not leave one?

GitHub-flavored Markdown & a sane subset of HTML is supported.