Utopian governance using technology, inc generative AI

Electrohabermas, digital deliberation, platform democracy

2025-10-27 — 2026-03-09

Wherein a personal advocate agent is imagined as a fiduciary proxy, bargaining at scale in a virtual agent economy, while preferences are conveyed through zero‑knowledge proofs and differential privacy.

adversarial
AI safety
bounded compute
communicating
cooperation
culture
economics
extended self
faster pussycat
incentive mechanisms
institutions
language
machine learning
markets
mind
money
neural nets
NLP
security
technology
wonk
Figure 1

Could Hayek’s dream of distributed information flows through the economy be put into practice in a more humane way using AI agents?

This is the market economy version of civic tech, where price signals and contracts are the medium of communication, and the goal is to coordinate economic activity. The argument is that a sufficiently advanced economic negotiation might be indistinguishable from democratic consensus-building, and that the economic and political spheres might merge in a Coasean Singularity—or at least that this is a possible future.

I have many thoughts about the risks and opportunities here. For now, just a placeholder.

1 Coasean Singularity

Seb Krier argues in Coasean Bargaining at Scale that a Coasean Singularity is arriving:

[…] consider AGI deployed as a vast ecology of personalized agents and systems. This emerging ecosystem is what Tomašev et al. (2025) characterize as the “virtual agent economy” a new economic layer where agents transact and coordinate at scales and speeds beyond direct human oversight. While this ecology will contain countless specialized agents, let’s focus on the one that matters most from an individual’s perspective: your personal advocate. Think of it as a fiduciary extension of yourself: a tireless, extremely competent digital representative, closely tied to you, its principal.

What could such an agent do? In principle, it can negotiate, calculate, compare, coordinate, verify, monitor, and much more in a split second. Through many multi-turn conversations, tweaking knobs and sliders, and continuous learning, it could also develop an increasingly sophisticated (though never perfect) model of who you are, your preferences, personal circumstances, values, resources, and more. This should evolve over time - an agent’s alignment should follow the principal’s own evolution. Recent research (Goyal, Chang, and Terry 2024) on negotiation agents finds that “human-agent alignment” is profoundly personal. Users expect agents to not only execute goals but also embody their identity, requiring alignment on everything from preferred negotiation tactics to personal ethical boundaries and the specific public reputation they wanted to project. There are of course important privacy considerations here, but none of these seem fundamentally intractable. For example these systems could be built on technologies like zero-knowledge proofs and differential privacy, ensuring that preferences are communicated and aggregated without revealing sensitive underlying data.

See also Shahidi et al. (2025).

2 Meaning economy

Related concept from Joe Edelman (of Couchsurfing fame): markets align with “deep human values”.

3 References

Allen-Zhu, and Xu. 2025. DOGE: Reforming AI Conferences and Towards a Future Civilization of Fairness and Justice.” SSRN Scholarly Paper.
Burton, Lopez-Lopez, Hechtlinger, et al. 2024. How Large Language Models Can Reshape Collective Intelligence.” Nature Human Behaviour.
Conitzer, Freedman, Heitzig, et al. 2024. Position: Social Choice Should Guide AI Alignment in Dealing with Diverse Human Feedback.” In Proceedings of the 41st International Conference on Machine Learning. ICML’24.
Dai, and Fleisig. 2024. Mapping Social Choice Theory to RLHF.” In.
Fish, Gölz, Parkes, et al. 2025. Generative Social Choice.”
Goyal, Chang, and Terry. 2024. Designing for Human-Agent Alignment: Understanding What Humans Want from Their Agents.” In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems.
Greenwald, and Stiglitz. 1986. Externalities in Economies with Imperfect Information and Incomplete Markets.” The Quarterly Journal of Economics.
Gudiño, Grandi, and Hidalgo. 2024. Large Language Models (LLMs) as Agents for Augmented Democracy.” Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.
Hernández. 2025. Towards Automating Deliberation? The Idea of Deliberative Democracy Embedded in Google’s Habermas Machine.” Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society.
Kasirzadeh, and Gabriel. 2025. Characterizing AI Agents for Alignment and Governance.”
Lazar. 2024a. Lecture I: Governing the Algorithmic City.”
———. 2024b. Lecture II: Communicative Justice and the Distribution of Attention.”
Lloyd, Nguyen, Levy, et al. 2025. Beyond Community Notes: A Framework for Understanding and Building Crowdsourced Context Systems.”
Novelli, Argota Sánchez-Vaquerizo, Helbing, et al. 2025. A Replica for Our Democracies? On Using Digital Twins to Enhance Deliberative Democracy.” AI & SOCIETY.
Nyhan, and Titiunik. 2024. Public Opinion Alone Won’t Save Democracy.” Science.
Ovadya. 2023a. Reimagining Democracy for AI.” Journal of Democracy.
———. 2023b. ‘Generative CI’ Through Collective Response Systems.”
Qiu, He, Chugh, et al. 2025. The Lock-in Hypothesis: Stagnation by Algorithm.” In.
Schneier, and Sanders. 2025. Rewiring Democracy: How AI Will Transform Our Politics, Government, and Citizenship. Strong Ideas.
Schrock. 2018. Civic Tech: Making Technology Work for People.
Seger, Ovadya, Siddarth, et al. 2023. Democratising AI: Multiple Meanings, Goals, and Methods.” In Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society. AIES ’23.
Shahidi, Rusak, Manning, et al. 2025. The Coasean Singularity? Demand, Supply, and Market Design with AI Agents.” In. Working Paper Series.
Shin, Floch, Rask, et al. 2024. A Systematic Analysis of Digital Tools for Citizen Participation.” Government Information Quarterly.
Sorensen, Mishra, Patel, et al. 2025. Value Profiles for Encoding Human Variation.”
Suresh, Tseng, Young, et al. 2024. Participation in the Age of Foundation Models.” In Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency. FAccT ’24.
Tan, and Abramsky. 2022. Institutions under composition.”
Tessler, Bakker, Jarrett, et al. 2024. AI Can Help Humans Find Common Ground in Democratic Deliberation.” Science.
Tomašev, Franklin, Leibo, et al. 2025. Virtual Agent Economies.”
Volpe. 2025. Toward an Artificial Deliberation? On Google DeepMind’s Habermas Machine.” Ethics and Information Technology.
Yang, and Bachmann. 2025. Bridging Voting and Deliberation with Algorithms: Field Insights from vTaiwan and Kultur Komitee.”
Yang, Dailisan, Korecki, et al. 2024. LLM Voting: Human Choices and AI Collective Decision-Making.” Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society.
Young, Ehsan, Singh, et al. 2024. Participation Versus Scale: Tensions in the Practical Demands on Participatory AI.” First Monday.
Zerilli. 2025. A Citizen’s Guide to Artificial Intelligence.