optimization

Neural denoising diffusion models Denoising diffusion probabilistic models (DDPMs), score-based generative models, generative diffusion processes, neural energy models… 2021-11-11 – 2022-09-24
Probability divergences Metrics, contrasts and divergences and other ways of quantifying how similar are two randomnesses 2014-11-25 – 2022-08-30
Pytorch #torched 2018-05-04 – 2022-08-13
Jax Julia for python 2020-09-15 – 2022-08-09
Neural nets with implicit layers Also, declarative networks, bi-level optimization and other ingenious uses of the implicit function theorem 2020-12-08 – 2022-08-09
ELBO Evidence lower bound, variational free energy etc 2020-10-02 – 2022-08-03
SLAM Simultaneous Location and Mapping 2014-11-25 – 2022-04-28
Sparse coding Wavelets, matching pursuit, overcomplete dictionaries… 2014-11-17 – 2022-03-07
Optimal transport inference I feel the earth mover under my feet, I feel the ψ tumbling down, I feel my heart start to trembling, Whenever you’re around my empirical density in minimal transport cost 2021-03-16 – 2022-02-22
Variational inference On fitting something not too far from a pretty good model that is not too hard 2016-03-22 – 2022-02-10
Reparameterization tricks in inference Pathwise gradient estimation, nNormalizing flows, invertible density models, inference by measure transport, low-dimensional coupling… 2018-04-04 – 2021-12-21
Hyperparameter optimization Replacing a hyperparameter problem with a hyperhyperparameter problem which feels like progress I guess 2020-09-25 – 2021-10-20
Meta learning Few-shot learning, learning fast weights, learning to learn 2021-09-16
Tensorflow The framework to use for deep learning if you groupthink like Google 2016-07-11 – 2021-07-07
Differentiable model selection Differentiable hyperparameter search, and architecture search, and optimisation optimisation by optimisation and so on 2020-09-25 – 2021-04-13
AutoML 2017-07-17 – 2020-10-02
Phase retrieval I’ve got the power. / Like the crack of the whip/ I snap attack/ Front to back 2017-01-16 – 2019-11-07
Statistical learning theory Eventually including structural risk minimisation, risk bounds, hopefully-uniform convergence rates, VC-dimension, generalisation-and-stability framings etc 2016-07-06 – 2016-08-16