Utopian governance using technology, inc generative AI

Electrohabermas, digital deliberation, platform democracy

2025-10-27 — 2025-12-02

Wherein an experiment is described in which a Habermas Machine is used to mediate UK group debates on Brexit and other divisive topics, and personal fiduciary agents are proposed as digital advocates.

adversarial
AI safety
bounded compute
communicating
cooperation
culture
economics
extended self
faster pussycat
incentive mechanisms
institutions
language
machine learning
markets
mind
money
neural nets
NLP
security
technology
wonk
Figure 1

The counterpart to AI disempowerment of humans is Utopian governance enabled by generative AI. What’s the best, kindest, and wisest collective behaviour we could achieve if generative AI helped govern us? Would discussion help us?

This isn’t the same as wondering how we might democratize AI—that’s interesting too.

1 Habermas machine experiment

Ekeoma Uzogara’s summary of Tessler et al. (2024):

To act collectively, groups must reach agreement; however, this can be challenging when discussants present very different but valid opinions. Tessler et al. (2024) investigated whether artificial intelligence (AI) can help groups reach a consensus during democratic debate (see Nyhan and Titiunik (2024) ). The authors trained a large language model called the Habermas Machine to serve as an AI mediator that helped small UK groups find common ground while discussing divisive political issues such as Brexit, immigration, the minimum wage, climate change, and universal childcare. Compared with human mediators, AI mediators produced more palatable statements that generated wide agreement and left groups less divided. The AI’s statements were more clear, logical, and informative without alienating minority perspectives. This work carries policy implications for AI’s potential to unify deeply divided groups.

See also: (Hernández 2025; Volpe 2025).

2 Platform democracy

See kinder social media.

3 Delegated Agent Economies

See delegated agent economies.

4 Political economy of cognition

See political economy of cognition for the foundational theory of what decision‑making looks like in the age of AI.

5 As an epistemic problem

TODO

6 Incoming

We list many more ideas on the generic utopian governance page that don’t depend on AI, though those ideas could still help us.

7 References

Allen-Zhu, and Xu. 2025. DOGE: Reforming AI Conferences and Towards a Future Civilization of Fairness and Justice.” SSRN Scholarly Paper.
Burton, Lopez-Lopez, Hechtlinger, et al. 2024. How Large Language Models Can Reshape Collective Intelligence.” Nature Human Behaviour.
Conitzer, Freedman, Heitzig, et al. 2024. Position: Social Choice Should Guide AI Alignment in Dealing with Diverse Human Feedback.” In Proceedings of the 41st International Conference on Machine Learning. ICML’24.
Dai, and Fleisig. 2024. Mapping Social Choice Theory to RLHF.” In.
Fish, Gölz, Parkes, et al. 2025. Generative Social Choice.”
Goyal, Chang, and Terry. 2024. Designing for Human-Agent Alignment: Understanding What Humans Want from Their Agents.” In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems.
Greenwald, and Stiglitz. 1986. Externalities in Economies with Imperfect Information and Incomplete Markets.” The Quarterly Journal of Economics.
Gudiño, Grandi, and Hidalgo. 2024. Large Language Models (LLMs) as Agents for Augmented Democracy.” Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.
Hernández. 2025. Towards Automating Deliberation? The Idea of Deliberative Democracy Embedded in Google’s Habermas Machine.” Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society.
Kasirzadeh, and Gabriel. 2025. Characterizing AI Agents for Alignment and Governance.”
Lazar. 2024a. Lecture I: Governing the Algorithmic City.”
———. 2024b. Lecture II: Communicative Justice and the Distribution of Attention.”
Lloyd, Nguyen, Levy, et al. 2025. Beyond Community Notes: A Framework for Understanding and Building Crowdsourced Context Systems.”
Novelli, Argota Sánchez-Vaquerizo, Helbing, et al. 2025. A Replica for Our Democracies? On Using Digital Twins to Enhance Deliberative Democracy.” AI & SOCIETY.
Nyhan, and Titiunik. 2024. Public Opinion Alone Won’t Save Democracy.” Science.
Ovadya. 2023a. Reimagining Democracy for AI.” Journal of Democracy.
———. 2023b. ‘Generative CI’ Through Collective Response Systems.”
Qiu, He, Chugh, et al. 2025. The Lock-in Hypothesis: Stagnation by Algorithm.” In.
Schneier, and Sanders. 2025. Rewiring Democracy: How AI Will Transform Our Politics, Government, and Citizenship. Strong Ideas.
Schrock. 2018. Civic Tech: Making Technology Work for People.
Seger, Ovadya, Siddarth, et al. 2023. Democratising AI: Multiple Meanings, Goals, and Methods.” In Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society. AIES ’23.
Shahidi, Rusak, Manning, et al. 2025. The Coasean Singularity? Demand, Supply, and Market Design with AI Agents.” In. Working Paper Series.
Shin, Floch, Rask, et al. 2024. A Systematic Analysis of Digital Tools for Citizen Participation.” Government Information Quarterly.
Sorensen, Mishra, Patel, et al. 2025. Value Profiles for Encoding Human Variation.”
Suresh, Tseng, Young, et al. 2024. Participation in the Age of Foundation Models.” In Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency. FAccT ’24.
Tan, and Abramsky. 2022. Institutions under composition.”
Tessler, Bakker, Jarrett, et al. 2024. AI Can Help Humans Find Common Ground in Democratic Deliberation.” Science.
Tomašev, Franklin, Leibo, et al. 2025. Virtual Agent Economies.”
Volpe. 2025. Toward an Artificial Deliberation? On Google DeepMind’s Habermas Machine.” Ethics and Information Technology.
Yang, and Bachmann. 2025. Bridging Voting and Deliberation with Algorithms: Field Insights from vTaiwan and Kultur Komitee.”
Yang, Dailisan, Korecki, et al. 2024. LLM Voting: Human Choices and AI Collective Decision-Making.” Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society.
Young, Ehsan, Singh, et al. 2024. Participation Versus Scale: Tensions in the Practical Demands on Participatory AI.” First Monday.
Zerilli. 2025. A Citizen’s Guide to Artificial Intelligence.