Epistemic communities
Descriptive and normative
2021-08-24 — 2026-04-17
Wherein the Several Aims of Collective Truth-Seeking Are Enumerated, and Their Mutual Incompatibility Is Noted, With Peer Review Instanced as the Community Most Amenable to Experimental Manipulation.
How do we run truth-converging epistemic communities under increasing tech mediation?
1 AI and Epistemic Communities
LLMs change the economics in ways I have not finished thinking through. “AI” below is used loosely — some of the tools are generative (LLMs as critics or mediators), others are classical-ML (matrix factorization on rating data, PCA-then-clustering on agree/disagree votes), and the lines blur in practice. Both shift the economics of an epistemic community. Civic tech and AI-mediated governance covers the deliberative-democracy slice in depth; here I’ll flag the cases that matter for epistemic communities specifically. The cases I find most concrete:
- Automated criticism. AI-assisted review for scientific papers [@AllenZhu2025DOGE]; the Black Spatula Project; o1 catching arithmetic errors; roastmypost. Arbitration — analysing an existing dispute — is cognitively easier than generating a novel critique, which suggests a division of labour where LLMs mop up the mechanical-correctness pass and humans focus on taste and framing.
- Civic-tech tooling. AI mediators (the DeepMind Habermas Machine, generative), bridging-based aggregation (Community Notes’ matrix factorization, Polis / vTaiwan’s PCA-and-clustering, classical ML), and participatory platforms — all covered in civic tech and AI-mediated governance, with bridging-based aggregation for the mathematics and the broader family (Ovadya & Thorburn, the Forethought design sketches for collective epistemics).
- Degraded signals. An LLM-saturated Quora is worse than the pre-LLM Quora. The cheaper passable-looking text gets, the more expensive it becomes to sort a community from its doppelgängers. Related: spamularity, misinformation, AI persuasion.
I suspect “does AI help or hurt?” is the wrong question — it’s underspecified. Better: how does AI shift the cost structure of the underlying mechanism? A community whose signal was mostly “could this person write a passable essay” is in trouble; one whose signal was mostly “could this person stake their reputation on a concrete forecast” is not.
2 Incoming
Coordination Tech in Science: Letters, Journals, and Whatever Comes Next | shishyko!
Sapience Labs · You own your intelligence
Your Sapience grows from your work and stays with you across AIs. Share what you choose, with your name attached. We are building a shared intelligence for humanity, so people and AI can discover what none of us could alone.
Encrypted swarm lab AI for collaboration and token efficiency
Substrate dynamics · attractor.space — is very beautiful and sounds like it is about this question, but fails to articulate an actual hypothesis or model while using words like substrate and membrane
AI Tools for Trust: Community Notes, Rhetoric Detection & More
Raymond Douglas, Epistemics and Coordination: It’s complicated!
Gordon Brander, Thinking together, on egregores, Dunbar numbers and information-processing thresholds in Holocene social evolution, which all motivate
- Noosphere, a protocol for thought
- source
- The explainer is poor and doesn’t even tell us how to start one of these noospheres or do anything in particular, which indicates a suspect development model.
Why Quora isn’t useful anymore: A.I. came for the best site on the internet.
