Welcome to Dan’s brain

The contents of my head are not useful if they stay in there, so I regularly copy-paste them onto the internet, into this very website. Here you can find most of the things I am thinking about, in the form of a higgledy heap of half-finished notebooks and occasional polished essays. Themes include whatever shiny thing distracted me into taking notes about it, including, but not limited to,

You might be after information about me generally, or what I am doing right now.

Show whimsical blog map

Curators of nice bits of internet

computers are awful together
making things
provenance

Static website editors

computers are awful together
diy
doing internet
faster pussycat
plain text
UI
workflow

Being stroppy

adaptive
collective knowledge
economics
evolution
game theory
networks
social graph
sociology

ML benchmarks and their pitfalls

economics
game theory
how do science
incentive mechanisms
institutions
machine learning
neural nets
statistics

Computational complexity results in neural nets

compsci
machine learning
making things
neural nets

Information storage and retrieval in NNs

economics
faster pussycat
innovation
language
machine learning
mind
neural nets
NLP
technology
UI

Singular Value Decomposition

feature construction
functional analysis
high d
linear algebra
networks
probability
signal processing
sparser than thou
statistics

Science; Institution design for

academe
agents
collective knowledge
economics
faster pussycat
game theory
how do science
incentive mechanisms
institutions
mind
networks
provenance
sociology
wonk

Orthonormal and unitary matrices

algebra
dynamical systems
functional analysis
geometry
high d
linear algebra
measure
signal processing
spheres
stochastic processes
time series

Neural vector embeddings

approximation
feature construction
geometry
high d
language
linear algebra
machine learning
metrics
neural nets
NLP

World models arising in foundation models.

approximation
Bayes
generative
language
machine learning
meta learning
Monte Carlo
neural nets
NLP
optimization
probabilistic algorithms
probability
statistics
stringology
time series

Disentangled representation learning

Bayes
bounded compute
dynamical systems
feature construction
high d
language
machine learning
metrics
mind
NLP
sparser than thou
statmech
stochastic processes

AI Zen Koans

machine learning
neural nets
language
mind
writing

Snowmobile or bicycle?

economics
faster pussycat
innovation
language
machine learning
mind
neural nets
NLP
stringology
technology
UI

Quarto integrated website system

academe
faster pussycat
how do science
javascript
julia
language
making things
plain text
premature optimization
python
R
writing

Neural network activation functions

calculus
classification
dynamical systems
geometry
machine learning
neural nets
physics
regression
sciml
statistics

Mechanistic interpretability

communicating
feature construction
high d
language
machine learning
metrics
mind
NLP
sparser than thou
statmech
stochastic processes

Commitment, contracts, cooperation

adaptive
agents
causal
cooperation
economics
evolution
extended self
game theory
graphical models
incentive mechanisms
learning
mind
networks
social graph
utility
wonk

Garbled highlights from ICLR 2025

neural nets
South East Asia
statistics

Bayesian epistemics

adaptive
agents
bounded compute
collective knowledge
control
cooperation
distributed
economics
evolution
extended self
game theory
how do science
incentive mechanisms
institutions
learning
machine learning
mind
networks
provenance
sociology
squad
standards
swarm
utility

Learning with theory of mind

adaptive
agents
bandit problems
bounded compute
collective knowledge
control
cooperation
distributed
economics
evolution
extended self
game theory
incentive mechanisms
learning
machine learning
mind
networks
swarm
utility

Science for policy

catastrophe
communicating
economics
ethics
how do science
mind
probability
statistics
tail risk
wonk

Design of multi-agent systems

agents
bounded compute
collective knowledge
concurrency hell
distributed
economics
edge computing
extended self
game theory
incentive mechanisms
machine learning
networks
swarm

Research discovery, synthesis planning

academe
collective knowledge
faster pussycat
how do science
institutions
mind
networks
provenance
sociology
wonk

Quarto

academe
faster pussycat
how do science
javascript
julia
language
making things
plain text
premature optimization
python
R
writing

Reinforcement learning

adaptive
agents
bandit problems
control
incentive mechanisms
learning
networks
stochastic processes
time series
utility

Particle variational message passing

approximation
Bayes
distributed
dynamical systems
generative
graphical models
machine learning
Monte Carlo
networks
optimization
particle
probabilistic algorithms
probability
sciml
signal processing
state space models
statistics
stochastic processes
swarm
time series

Code generation, programming assistants

faster pussycat
language
machine learning
making things
neural nets
NLP
signal processing
stringology
UI

q-exponential process

Gaussian
Hilbert space
kernel tricks
Lévy processes
nonparametric
regression
spatial
stochastic processes
time series

Internet for the occasionally online

computers are awful
computers are awful together
confidentiality
distributed
diy
economics

Recurrent / convolutional / state-space

Bayes
convolution
dynamical systems
functional analysis
linear algebra
machine learning
making things
music
networks
neural nets
nonparametric
probability
signal processing
sparser than thou
state space models
statistics
time series

Prepping for the end of (my access to) the (industrialised) world

catastrophe
cooperation
economics
fashion
hand wringing
social graph
wonk

Singapore

South East Asia
statistics

Gradient steps to an ecology of mind

adaptive
agents
collective knowledge
cooperation
culture
economics
energy
evolution
extended self
game theory
gene
incentive mechanisms
learning
mind
networks
probability
social graph
sociology
statistics
statmech
utility
wonk

Which self?

economics
ethics
extended self
gene
incentive mechanisms
institutions
mind
utility

Knowledge geometry

collective knowledge
how do science
stringology
topology

AI search

boring
computers are awful together
faster pussycat
incentive mechanisms
mind
NLP
provenance
search
wonk

Machine learning for inverting partial differential equations

calculus
dynamical systems
geometry
Hilbert space
how do science
machine learning
neural nets
PDEs
physics
regression
sciml
SDEs
signal processing
statistics
statmech
stochastic processes
surrogate
time series
uncertainty

Graphical model / machine learning decoder ring

algebra
graphical models
hidden variables
hierarchical models
how do science
machine learning
networks
neural nets
probability
statistics
when to compute

Conflict theoretic models

adaptive
bounded compute
cooperation
culture
economics
evolution
game theory
incentive mechanisms
networks
wonk

Variational Bayes Neural Nets and Graphical Models

algebra
graphical models
hidden variables
hierarchical models
how do science
machine learning
networks
neural nets
probability
statistics

Configuring machine learning experiments with Fiddle

computers are awful
faster pussycat
how do science
premature optimization
provenance
python

Economics of automation,

economics
faster pussycat
innovation
language
machine learning
mind
neural nets
technology
UI
No matching items