Hyperparameter optimization in ML Replacing a hyperparameter problem with a hyperhyperparameter problem which feels like progress I guess 2020-09-25 – 2021-03-01

Random-forest-like methods Boosting, bagging and other weak-learner ensemble methods 2015-09-23 – 2021-02-11

Model averaging On keeping many incorrect hypotheses and using them all as one goodish one 2017-06-20 – 2020-03-22

Nearly sufficient statistics How about “Sufficient sufficiency”? — is that taken? 2018-03-13 – 2019-01-14

Statistical learning theory Eventually including structural risk minimisation, risk bounds, hopefully-uniform convergence rates, VC-dimension, generalisation-and-stability framings etc 2016-07-06 – 2016-08-16