Optimisation of surrogate models for experiment design The next best thing to optimizing is optimizing the next best thing 2017-04-11 – 2020-10-13

Hyperparameter optimization in ML Replacing a hyperparameter problem with a hyperhyperparameter problem which feels like progress I guess 2020-09-25 – 2020-10-06

Model averaging On keeping many incorrect hypotheses and using them all as one goodish one 2017-06-20 – 2020-03-22

Nearly sufficient statistics How about “Sufficient sufficiency”? — is that taken? 2018-03-13 – 2019-01-14

Statistical learning theory Eventually including structural risk minimisation, risk bounds, hopefully-uniform convergence rates, VC-dimension, generalisation-and-stability framings etc 2016-07-06 – 2016-08-16