# Model selection

Cross validation
2016-09-05
– 2021-05-13
Stein’s method
2021-03-12
– 2021-05-12
Infinite width limits of neural networks
2020-12-09
– 2021-05-11
Tests, statistical
Maybe also design of experiments while we are here?
2014-08-23
– 2021-04-20
Differentiable model selection
Differentiable hyperparameter search, and architecture search, and optimisation optimisation by optimisation and so on
2020-09-25
– 2021-04-13
Generically approximating probability distributions
2021-03-12
– 2021-03-22
ML scaling laws in the massive model limit
2021-01-14
– 2021-03-15
Matrix measure concentration inequalities and bounds
2014-11-25
– 2021-03-08
Measure concentration inequalities
On being 80% sure you are only 20% wrong
2014-11-25
– 2021-03-04
Hyperparameter optimization in ML
Replacing a hyperparameter problem with a hyperhyperparameter problem which feels like progress I guess
2020-09-25
– 2021-03-01
Random-forest-like methods
Boosting, bagging and other weak-learner ensemble methods
2015-09-23
– 2021-02-11
Regularising neural networks
Generalisation for street fighters
2017-02-12
– 2020-12-01
Weighted data in statistics
2020-11-04
– 2020-11-06
Automatic design of experiments
Minesweeper++
2017-04-11
– 2020-10-13
Sparse model selection
2016-09-05
– 2020-10-02
AutoML
2017-07-17
– 2020-10-02
Data summarization
On maps drawn at smaller than 1:1 scale
2019-01-14
– 2020-09-18
Independence, conditional, statistical
2016-04-21
– 2020-09-13
Minimum description length
2020-08-06
Model complexity penalties
Information criteria, degrees of freedom etc
2015-04-22
– 2020-06-22
Long memory time series
2011-11-13
– 2020-05-28
Forecasting
Haruspicy 2.0
2015-06-16
– 2020-05-21
Limit Theorems
Asymptotic distributions of random processes
2014-11-25
– 2020-05-06
Model averaging
On keeping many incorrect hypotheses and using them all as one goodish one
2017-06-20
– 2020-03-22
Effective sample size
2016-11-21
– 2020-03-03
Convergence of random variables
2019-12-03
Sparse regression
2016-06-23
– 2019-10-24
Statistical learning theory for time series
2016-11-03
– 2019-10-01
Bayesian model selection
2017-08-20
– 2019-07-22
Wacky regression
2015-09-23
– 2019-05-02
Nearly sufficient statistics
How about “Sufficient sufficiency”? — is that taken?
2018-03-13
– 2019-01-14
Bayesian sparsity
2019-01-08
Multiple testing
2015-04-22
– 2018-11-05
Post-selection inference
Adaptive data analysis without cheating
2017-08-20
Model/hyperparameter selection
2016-04-15
– 2017-08-20
Compressed sensing / compressed sampling
The fanciest ways of counting zero
2014-08-18
– 2017-06-14
Stability (in learning)
2016-05-25
– 2016-10-05
Penalised/regularised regression
2016-06-23
– 2016-09-15
Statistical learning theory
Eventually including structural risk minimisation, risk bounds, hopefully-uniform convergence rates, VC-dimension, generalisation-and-stability framings etc
2016-07-06
– 2016-08-16
Randomised linear algebra
2016-08-16