Dynamics of recommender systems and other AI social interventions at societal scale

Variational approximations to high modernism



Kleinberg and Raghavan (2021)

Algorithmic monoculture is a growing concern in the use of algorithms for high-stakes screening decisions in areas such as employment and lending. If many firms use the same algorithm, even if it is more accurate than the alternatives, the resulting “monoculture” may be susceptible to correlated failures, much as a monocultural system is in biological settings. To investigate this concern, we develop a model of selection under monoculture. We find that even without any assumption of shocks or correlated failures—i.e., under “normal operations”—the quality of decisions may decrease when multiple firms use the same algorithm. Thus, the introduction of a more accurate algorithm may decrease social welfare—a kind of “Braess’ paradox” for algorithmic decision-making.

References

Carroll, Micah, Anca Dragan, Stuart Russell, and Dylan Hadfield-Menell. 2022. Estimating and Penalizing Induced Preference Shifts in Recommender Systems.” arXiv.
Dean, Sarah, and Jamie Morgenstern. 2022. Preference Dynamics Under Personalized Recommendations.” arXiv.
Eilat, Itay, and Nir Rosenfeld. 2023. Performative Recommendation: Diversifying Content via Strategic Incentives.” arXiv.
Hron, Jiri, Karl Krauth, Michael I. Jordan, Niki Kilbertus, and Sarah Dean. 2022. Modeling Content Creator Incentives on Algorithm-Curated Platforms.” arXiv.
Kleinberg, Jon, and Manish Raghavan. 2021. Algorithmic Monoculture and Social Welfare.” Proceedings of the National Academy of Sciences 118 (22): e2018340118.
Leqi, Liu, Dylan Hadfield-Menell, and Zachary C. Lipton. 2021. When Curation Becomes Creation: Algorithms, Microcontent, and the Vanishing Distinction Between Platforms and Creators.” Queue 19 (3): Pages 30:11–15.
Raghavan, Manish. 2021. The Societal Impacts of Algorithmic Decision-Making.” Cornell University Library.
Stray, Jonathan, Alon Halevy, Parisa Assar, Dylan Hadfield-Menell, Craig Boutilier, Amar Ashar, Lex Beattie, et al. 2022. Building Human Values into Recommender Systems: An Interdisciplinary Synthesis.” arXiv.
Stray, Jonathan, Ivan Vendrov, Jeremy Nixon, Steven Adler, and Dylan Hadfield-Menell. 2021. What Are You Optimizing for? Aligning Recommender Systems with Human Values.” arXiv.
Teeny, Jacob D., Joseph J. Siev, Pablo Briñol, and Richard E. Petty. 2021. A Review and Conceptual Framework for Understanding Personalized Matching Effects in Persuasion.” Journal of Consumer Psychology 31 (2): 382–414.
Xu, Ruqing, and Sarah Dean. 2023. Decision-Aid or Controller? Steering Human Decision Makers with Algorithms.” arXiv.

No comments yet. Why not leave one?

GitHub-flavored Markdown & a sane subset of HTML is supported.