information

Playing video Pumping bits to eyeballs 2020-04-23 – 2023-11-06

Quantization 2016-03-29 – 2023-11-02

Informations Entropies and other measures of surprise 2011-11-25 – 2023-09-04

Model averaging On keeping many incorrect hypotheses and using them all as one goodish one 2017-06-20 – 2023-07-24

Data summarization On maps drawn at smaller than 1:1 scale 2019-01-14 – 2023-04-27

Bayesian model selection by model evidence maximisation Type II maximum likelihood, marginal maximum likelihood, Bayes Occam’s razor 2017-08-20 – 2022-12-22

Neural codecs Digital recordings and converting between them. 2020-04-23 – 2022-12-19

Hamiltonian and Langevin Monte Carlo Physics might be on to something 2018-07-31 – 2022-11-14

Bayesian sparsity 2019-01-08 – 2022-10-25

Transcoding Digital recordings and converting between them. 2020-04-23 – 2022-10-05

The language game Coevolution of words and meanings 2014-12-29 – 2022-04-01

Random binary vectors The class of distributions that cause you to reinvent Shannon information if you stare at them long enough 2017-02-20 – 2022-03-30

Learning with conservation laws, invariances and symmetries 2020-04-11 – 2022-02-25

Algorithmic statistics Probably also algorithmic information theory 2014-07-25 – 2021-09-26

Data dimensionality reduction Wherein I teach myself, amongst other things, feature selection, how a sparse PCA works, and decide where to file multidimensional scaling 2015-03-22 – 2020-09-11

Minimum description length 2020-08-06

Model complexity penalties Information criteria, degrees of freedom etc 2015-04-22 – 2020-06-22

Empirical estimation of information Informing yourself from your data how informative your data was 2011-04-19 – 2020-04-28

Mixture models for density estimation 2016-03-29 – 2020-04-24

Bayesian model selection 2017-08-20 – 2019-07-22

Nearly sufficient statistics How about “Sufficient sufficiency”? — is that taken? 2018-03-13 – 2019-01-14

Post-selection inference Adaptive data analysis without cheating 2017-08-20

Model/hyperparameter selection 2016-04-15 – 2017-08-20

Granger causation/Transfer Entropy 2012-07-26 – 2017-05-04

Computational mechanics 2011-10-17 – 2015-01-02