Governance of and by AI
2025-01-19 — 2025-01-19
Wherein the Governance of and by AI Are Examined in a Measured Survey, and the Rise of National AI Safety Institutes and Legislative Briefings Is Noted as a Concrete Locus for Regulatory and Alignment Experiments.
1 Incoming
MINT AGI Governance Bibliography
This bibliography is a work in progress. The basic criterion is: work that is relevant for AGI governance, that is worth reading. I’m open to including more clusters, and very open to suggestions for readings I’ve missed. I emphasise, though, that this is intentionally limited to work engaging with frontier AI and beyond. There is a very deep and rich literature on the societal impacts and governance of AI more broadly (and computing more broadly) which I have omitted here, because it needs its own bibliography. I am working to make our Lab corpus available for access via MCP so that your agents can crawl it for a set of reading suggestions that goes further back into the literature. In the meantime, the zip below contains embeddings of all these papers that your agents can search through; every paper should also have a link to its online version, and to a google drive version, where you can request access.
Wong and Bartlett (2022)
we hypothesize that once a planetary civilization transitions into a state that can be described as one virtually connected global city, it will face an ‘asymptotic burnout’, an ultimate crisis where the singularity-interval time scale becomes smaller than the.env time scale of innovation. If a civilization develops the capability to understand its own trajectory, it will have a window of time to affect a fundamental change to prioritize long-term homeostasis and well-being over unyielding growth—a consciously induced trajectory change or ‘homeostatic awakening’. We propose a new resolution to the Fermi paradox: civilizations either collapse from burnout or redirect themselves to prioritising homeostasis, a state where cosmic expansion is no longer a goal, making them difficult to detect remotely.
Ten Hard Problems in and around AI
We finally published our big 90-page intro to AI. Its likely effects, from ten perspectives, ten camps. The whole gamut: ML, scientific applications, social applications, access, safety and alignment, economics, AI ethics, governance, and classical philosophy of life.
AI Safety Fundamentals: AI Governance Fast-Track – BlueDot Impact
What We Learned from Briefing 70+ Lawmakers on the Threat from AI