ML scaling in the massive parameter limit 2021-01-14

Statistical mechanics of statistics 2016-12-01 – 2021-01-06

Why does deep learning work? Are we in the pocket of Big VRAM? 2017-05-30 – 2020-12-14

Machine learning for physical sciences Turbulent mixing at the boundary between two disciplines with differing inertia and viscosity 2017-05-15 – 2020-12-12

Neural nets with implicit layers 2020-12-08 – 2020-12-12

Free energy Fancy analogy for understanding cognition 2011-11-27 – 2020-12-01

Machine learning for partial differential equations 2017-05-15 – 2020-11-23

Observability and sensitivity in learning dynamical systems Parameter identifiability in dynamical models 2020-11-09

Gradient descent First order of business 2014-10-04 – 2020-10-27

Time Certain quirks of entropy 2020-10-20

Automatic design of experiments Minesweeper++ 2017-04-11 – 2020-10-13

Hyperparameter optimization in ML Replacing a hyperparameter problem with a hyperhyperparameter problem which feels like progress I guess 2020-09-25 – 2020-10-06

AutoML 2017-07-17 – 2020-10-02

Hydrology models Rivers, aquifers and all that 2020-09-07 – 2020-09-17

Emulators and surrogate models Shortcuts in scientific simulation using ML 2020-08-12 – 2020-08-26

Multi fidelity models 2020-08-24

Bushfire models 2020-09-07 – 2020-08-19

Lévy processes 2017-05-29 – 2020-07-25

Mind as statistical learner 2020-06-23 – 2020-06-26

Quantum computing 2017-12-14 – 2020-05-23

Learning with conservation laws, invariances and symmetries 2020-04-11 – 2020-05-01

Deep learning as a dynamical system 2018-08-13 – 2020-04-02

Morphogenesis 2011-01-19 – 2020-03-05

Potential theory in probability Something about harmonic functions or whatever 2020-02-12

Spatial point process and their statistics 2016-08-17 – 2019-12-04

Gradient descent, Higher order 2019-10-26

Informations Entropies and other measures of surprise 2011-11-25 – 2019-09-10

Semidefinite proramming 2019-06-29

Optimisation 2014-10-04 – 2019-06-27

Point processes 2016-08-01 – 2019-02-18

Algorithmic statistics 2014-07-25 – 2019-01-15

Overparameterization a.k.a. improper learning 2018-04-04 – 2018-12-11

Ergodic theory / mixing For things that probably happen eventually 2011-10-17 – 2018-10-23

Pattern formation 2014-12-23 – 2018-10-09

Optimisation, combinatorial 2018-08-11

Quantum information in physics What are qubits again? 2017-07-24 – 2017-12-14

Gradient descent, continuous, primal/dual formulations. 2017-08-07

Thermodynamics of life 2014-09-23 – 2017-05-30

This is a simulation 2017-04-04

Distributed optimization for regression 2016-10-11

Statistical learning theory Eventually including structural risk minimisation, risk bounds, hopefully-uniform convergence rates, VC-dimension, generalisation-and-stability framings etc 2016-07-06 – 2016-08-16

Material basis of the economy 2011-10-17 – 2016-08-01

Dynamical systems 2016-04-26 – 2016-07-27

Fluctuation-relaxation/response/dissipation 2016-06-07

Thermodynamics 2015-02-20 – 2016-01-18

Statistical mechanics 2015-11-14

Earthquakes 2015-07-14

Complexity 2011-11-25 – 2015-04-11

Computational mechanics 2011-10-17 – 2015-01-02

Flocking 2011-04-19 – 2014-11-20

Econophysics 2011-04-13

Simulation for the social sciences 2010-09-28