What even is “agency”?

2026-03-02 — 2026-04-10

Wherein the concept of agency is interrogated by means of several edge cases, including addiction, coercive control, and cult membership, and its boundaries are left undetermined.

adaptive
agents
AI safety
cooperation
economics
evolution
extended self
game theory
incentive mechanisms
learning
mind
networks
utility
wonk

We are very exercised about whether we have agency. What is it actually? What does it even mean to say that we have agency? Can we ground our intuition about agency into something precise?

Do we even want it, or is being the grown up not necessarily in our best interests?

These are all questions I don’t have answers to.

Here I have collected a list of edge cases for “agency” that I hope might help me delineate its boundaries.

Figure 1

1 Cults and agency

The Antidote to Trickery is an interview with Diane Benscoter, a de-radicalisation expert, who argues that there is a distinction between being programmed by a cult and being de-programmed by a non-cult.

Is sublimating my goals to a larger group really a loss of agency?

2 Is domestication a loss of agency?

See Human domestication.

3 Coercive control

Researchers seem to agree that coercive control is a thing, and that it’s bad (Lohmann et al. 2024). So intuitively some of the things that agency should include are things that should be diminished by coercive control.

cf What the research evidence tells us about coercive control victimisation.

4 Addiction

Is addiction a loss of agency?

5 “High-agency” vs NPC

Jasmine Sun decodes the Bay Area use of the term

You can be a top-ranked competitive coder or know every world leader’s birthday by heart, but the only real metric of success is whether you can build a life you’re happy with. Cold-emailing your way into a dream job is pretty high-agency; quitting it to become a strawberry farmer is even more so. Agency is initiative, resourcefulness, a high internal locus of control. Not stressing about roadblocks and assuming you’ll figure it out along the way.

6 Attention hacking

If my attention is being hacked, do I lose agency?

7 Reward tampering

If my preferences are altered to be what some other entity wishes them to be, do I lose agency?

8 Empowerment

If I am empowered, do I gain agency?

9 References

Biehl, and Virgo. 2023. Interpreting Systems as Solving POMDPs: A Step Towards a Formal Understanding of Agency.” In.
Bowles, Choi, and Hopfensitz. 2003. The Co-Evolution of Individual Behaviors and Social Institutions.” Journal of Theoretical Biology.
Bullock, Hammond, and Krier. 2025. AGI, Governments, and Free Societies.”
Critch, Dennis, and Russell. 2022. Cooperative and Uncooperative Institution Designs: Surprises and Problems in Open-Source Game Theory.”
Farrell, Gopnik, Shalizi, et al. 2025. Large AI Models Are Cultural and Social Technologies.” Science.
Halpern, and Kleiman-Weiner. 2018. Towards Formal Definitions of Blameworthiness, Intention, and Moral Responsibility.”
Kang, and Lou. 2022. AI Agency Vs. Human Agency: Understanding Human–AI Interactions on TikTok and Their Implications for User Engagement.” Journal of Computer-Mediated Communication.
Kenton, Kumar, Farquhar, et al. 2023. Discovering Agents.” Artificial Intelligence.
Kulveit, Douglas, Ammann, et al. 2025. Gradual Disempowerment: Systemic Existential Risks from Incremental AI Development.”
Liu, Wang, Li, et al. 2024. Attaining Human Desirable Outcomes in Human-AI Interaction via Structural Causal Games.”
Loewith, and Street. 2025. Mutual Prediction in Human–AI Coevolution.” Antikythera Digital Journal.
Lohmann, Cowlishaw, Ney, et al. 2024. The Trauma and Mental Health Impacts of Coercive Control: A Systematic Review and Meta-Analysis.” Trauma, Violence & Abuse.
Morris. 2015. Foragers, Farmers, and Fossil Fuels: How Human Values Evolve. Edited by Stephen Macedo.
Orseau, McGill, and Legg. 2018. Agents and Devices: A Relative Definition of Agency.”
Pang. 2026. “On the Markovian Dynamics of Computational Systems.”
Qiu, He, Chugh, et al. 2025. The Lock-in Hypothesis: Stagnation by Algorithm.” In.
Ward, MacDermott, Belardinelli, et al. 2024. The Reasons That Agents Act: Intention and Instrumental Goals.”