machine_learning

Voice transcriptions and speech recognition 2019-01-08 – 2023-12-05

Generative music with language+diffusion models 2022-09-16 – 2023-12-05

Natural language processing software Dave, although you took very thorough precautions in the pod against my hearing you, I could see your lips move. 2018-01-11 – 2023-12-03

System identification in continuous time Learning in continuous ODEs, SDEs and CDEs 2016-08-01 – 2023-11-30

Learning graphical models from time series Also, causal discovery, structure discovery in time series 2017-09-20 – 2023-11-28

Simulation-based inference 2014-12-23 – 2023-11-23

Multi fidelity models Data-driven multi-scale sampling, multi-resolution, super-resolution 2020-08-24 – 2023-11-20

Machine learning for partial differential equations 2017-05-15 – 2023-11-17

Feedback system identification, not necessarily linear Learning dynamics from data 2016-08-01 – 2023-11-15

Generative industrial design 2022-09-16 – 2023-11-13

Hydrology, applied Rivers, aquifers and other wet things that can flood your house 2020-09-07 – 2023-10-27

Causal inference in highly parameterized ML 2020-09-18 – 2023-10-24

Learning under distribution shift Also transfer learning, covariate shift, transferable learning, domain adaptation, transportability etc 2020-10-17 – 2023-10-24

Physics-informed neural networks 2019-10-15 – 2023-10-19

Neural PDE operator learning Especially forward operators. Image-to-image regression, where the images encode a physical process. 2019-10-15 – 2023-10-19

Technological singularities Incorporating hard AI take-offs, game-over high scores, the technium, deus-ex-machina, deus-ex-nube, nerd raptures and so forth 2016-12-01 – 2023-10-11

Probabilistic numerics 2023-07-13 – 2023-09-25

Machine learning for climate systems 2020-04-02 – 2023-09-25

Statistics and machine learning 2011-04-15 – 2023-09-13

Code generation, programming assistants 2021-10-14 – 2023-08-28

Browser machine learning 2017-01-13 – 2023-08-22

ML on small devices Putting intelligence on chips small enough to be in disconcerting places 2016-10-14 – 2023-08-14

Materials informatics Machine learning in condensed matter physics, chemistry and materials science 2023-08-01 – 2023-08-08

Snowmobile or bicycle? Complement or substitute? 2023-03-23 – 2023-08-07

Economics of large language models 2023-03-23 – 2023-08-07

Ablation studies and lesion studies In order to understand it we must be able to break it 2016-10-26 – 2023-08-01

Learnable coarse-graining Approximate meso-scale physics 2020-08-24 – 2023-08-01

AV controller interfaces 2019-12-10 – 2023-08-01

Factor graphs 2019-12-16 – 2023-07-31

Hypothesis tests, statistical 2014-08-23 – 2023-07-18

Generative art with language+diffusion models 2022-09-16 – 2023-07-16

Gaussian process ensembles Bayesian committee machines, product-of-experts 2023-07-12

Bayes neural nets via subsetting weights 2017-01-11 – 2023-07-03

Neural nets with implicit layers Also, declarative networks, bi-level optimization and other ingenious uses of the implicit function theorem 2020-12-08 – 2023-06-28

Position encoding Also Fourier features 2021-01-21 – 2023-06-23

Neural nets that do symbolic maths 2019-12-09 – 2023-06-14

Neural vector embeddings Hyperdimensional Computing, Vector Symbolic Architectures, Holographic Reduced Representations 2017-12-20 – 2023-06-13

Contrastive learning 2020-04-22 – 2023-06-06

Statistical mechanics of statistics 2016-12-01 – 2023-06-02

Recurrent / convolutional / state-space Translating between means of approximating time series dynamics 2016-04-05 – 2023-05-24

Neural learning dynamical systems 2018-08-13 – 2023-05-23

Belief propagation 2014-11-25 – 2023-05-17

Canonical correlation 2014-08-23 – 2023-05-17

Differentiable PDE solvers 2017-05-15 – 2023-05-15

Multi-objective optimisation 2021-07-14 – 2023-05-04

Probabilistic neural nets Bayesian and other probabilistic inference in overparameterized ML 2017-01-11 – 2023-04-27

Neural implicit representations Neural nets as coordinate mappings 2021-01-21 – 2023-04-26

Dynamics of recommender systems and other AI social interventions at societal scale Variational approximations to high modernism 2023-07-03 – 2023-04-26

Generative AI workflows and hacks 2023-03-23 – 2023-04-26

Quantified self Instrumentation and analytics for body and soul. Punk DIY precision medicine. 2022-01-11 – 2023-04-24

Model order reduction 2015-03-22 – 2023-04-21

ΦFlow A modern python computational fluid dynamics library for ML research 2022-06-24 – 2023-04-17

MLP-Mixer neural networks 2021-11-21 – 2023-03-30

Practical text generation and writing assistants 2019-01-08 – 2023-03-23

Transformer networks The transformer-powered subtitle for this article is “Our most terrifyingly effective weapon against the forces of evil is our ability to laugh at them.” 2017-12-20 – 2023-03-22

Deep sets invariant and equivariant functions 2022-11-24 – 2023-03-21

(Nearly-)Convex relation of nonconvex problems 2018-04-04 – 2023-03-17

Symbolic regression 2023-03-14

External validity When does what I learn on one data set apply to another? 2020-10-17 – 2023-02-16

Last-layer Bayes neural nets Bayesian and other probabilistic inference in overparameterized ML 2017-01-11 – 2023-02-09

Visualising probabilistic graphical models Also related models, such as Neural nets 2018-03-29 – 2023-02-02

Implementing neural nets 2016-10-14 – 2023-01-27

Variational message-passing algorithms in graphical models Cleaving reality at the joint, then summing it at the marginal 2014-11-25 – 2023-01-12

Goodhart’s Law 2019-12-22 – 2023-01-11

Graph neural nets 2020-09-16 – 2022-12-19

Machine learning for physical sciences Turbulent mixing at the boundary between disciplines with differing inertia and viscosity 2017-05-15 – 2022-12-07

Density ratio tricks 2022-12-06

Adverse advice selection 2022-01-25 – 2022-11-15

Interaction effects and subgroups are probably what we want to estimate 2022-01-25 – 2022-11-06

Personalized medicine Precision medicine 2022-01-25 – 2022-11-06

Deep learning as a dynamical system 2018-08-13 – 2022-10-30

The edge of chaos Computation, evolution, competition and other past-times of faculty 2016-12-01 – 2022-10-30

Neural tangent kernel 2020-12-09 – 2022-10-14

Continuous and equilibrium probabilistic graphical models 2014-08-05 – 2022-10-10

Learning graphical models from data Also, causal discovery, structure discovery 2017-09-20 – 2022-10-01

Ensemble Kalman methods for training neural networks Data assimilation for network weights 2022-09-20

Laplace approximations in inference Lightweight uncertainties, especially for heavy neural nets 2021-07-28 – 2022-09-06

Gaussian belief propagation Least squares at maximal elaboration 2014-11-25 – 2022-09-01

Scattering transforms 2022-03-16 – 2022-08-31

Semantics Compressed representations of reality for syntactic agents; which might be what meaning means 2014-12-29 – 2022-08-28

Elliptical belief propagation Generalized least generalized squares 2022-08-22 – 2022-08-23

Neural nets with implicit layers Also, declarative networks, bi-level optimization and other ingenious uses of the implicit function theorem 2020-12-08 – 2022-08-09

Causal inference on DAGs Confounding! This scientist performed a miracle graph surgery intervention and you won’t believe what happened next 2016-10-26 – 2022-08-06

Instumental variables and two stage regression Confounding! This scientist performed a miracle graph surgery intervention and you won’t believe what happened next 2016-10-26 – 2022-08-06

Neural net attention mechanisms On brilliance through selective ignorance 2017-12-20 – 2022-08-05

Neural learning for spatiotemporal systems 2020-09-16 – 2022-07-28

Bayes linear regression and basis-functions in Gaussian process regression a.k.a Fixed Rank Kriging, weight space GPs 2022-02-22 – 2022-07-27

Integrated Nested Laplace Approximation 2021-07-28 – 2022-07-26

Hydrology, applied Rivers, aquifers and other wet things that can flood your house 2020-09-07 – 2022-06-30

Overparameterization in large models Improper learning, benign overfitting, double descent 2018-04-04 – 2022-05-27

Model interpretation and explanation Colorizing black boxes 2016-09-01 – 2022-05-06

(Discrete-measure)-valued stochastic processes 2019-10-10 – 2022-05-04

Measure-valued stochastic processes Moving masses 2020-10-16 – 2022-05-03

Causal graphical model reading group 2022 Causal inference 2022-04-01 – 2022-04-29

SLAM Simultaneous Location and Mapping 2014-11-25 – 2022-04-28

Vecchia factoring of GP likelihoods Ignore some conditioning in the dependencies and attain a sparse cholesky factor for the precision matrix 2022-04-27

Hierarchical models DAGs, multilevel models, random coefficient models, mixed effect models, structural equation models… 2015-06-07 – 2022-04-21

Model fairness 2018-11-29 – 2022-04-21

Particle belief propagation Graphical inference using empirical distribution estimates 2014-07-25 – 2022-04-08

Particle Markov Chain Monte Carlo Particle systems as MCMC proposals 2014-07-25 – 2022-04-08

Probabilistic neural nets Inferring distributions in neural nets 2017-01-11 – 2022-04-07

Partition-valued random variates 2022-04-01

Measure-valued random variates Including completely random measures and many generalizations 2020-10-16 – 2022-03-30

Reservoir Computing 2022-03-28

Learning Gaussian processes which map functions to functions 2020-12-07 – 2022-02-25

Learning with conservation laws, invariances and symmetries 2020-04-11 – 2022-02-25

Moral calculus 2014-08-04 – 2022-02-19

Differentiable learning of automata 2016-10-14 – 2022-02-19

Neurons Neural networks made of real neurons, in functioning brains 2014-11-03 – 2022-02-14

Probabilistic graphical models 2014-08-05 – 2022-02-08

Random graphical models Causality in amongst confusion 2021-10-26 – 2022-02-07

Neural nets with basis decomposition layers 2021-03-09 – 2022-02-01

Here’s how I would do art with machine learning if I had to 2016-06-06 – 2022-02-01

Running neural nets backwards 2022-01-29

Learning on manifolds Finding the lowest bit of a krazy straw, from the inside 2011-10-21 – 2022-01-26

Feedback system identification, linear 2016-07-27 – 2022-01-21

Causality via potential outcomes Neyman-Rubin, counterfactuals, conditional treatment effects, and related tricks 2016-10-26 – 2021-12-10

Convolutional subordinator processes 2021-03-08 – 2021-12-01

Gaussian Processes as stochastic differential equations Imposing time on things 2019-09-18 – 2021-11-25

Ensembling neural nets Monte Carlo 2020-12-14 – 2021-11-25

Convolutional neural networks 2017-11-10 – 2021-11-21

Probably Approximately Correct 2014-11-24 – 2021-10-27

Neural music synthesis 2016-01-15 – 2021-10-14

Random neural networks 2017-02-17 – 2021-10-12

Missing data Imputation, estimation despite etc 2021-10-07

Regularising neural networks Generalisation for street fighters 2017-02-12 – 2021-09-24

Economics of automation When to the robots come for my job? 2021-09-20

Approximate Bayesian Computation Posterior updates without likelihood 2020-08-25 – 2021-09-20

Biological basis of language 2018-01-11 – 2021-09-16

Natural language processing Automatic processing of words and sentences and such 2018-01-11 – 2021-09-16

Recurrent neural networks 2016-06-16 – 2021-09-06

Convolutional stochastic processes Moving averages of noise 2021-03-01 – 2021-08-16

Grammar induction 2011-05-30 – 2021-08-09

Generalized linear models 2016-03-24 – 2021-08-05

Neural network activation functions 2017-01-12 – 2021-08-02

Learning summary statistics 2020-04-22 – 2021-07-15

Multi-task ML 2021-07-14

Moral philosophy 2014-08-04 – 2021-07-01

Distributed sensing, swarm sensing, adaptive social learning 2014-10-13 – 2021-06-28

ML Koans Passing through the NAND-gate 2021-06-23

Voice fakes 2018-09-06 – 2021-06-17

Neural net kernels 2019-09-16 – 2021-05-24

Infinite width limits of neural networks 2020-12-09 – 2021-05-11

Compressing neural nets pruning, compacting and otherwise fitting a good estimate into fewer parameters 2016-10-14 – 2021-05-07

ML benchmarks and their pitfalls On marginal efficiency gain in paperclip manufacture 2020-08-16 – 2021-04-13

Statistics, computational complexity thereof 2020-11-03 – 2021-03-10

Mind reading by computer The ultimate inverse problem 2017-07-01 – 2021-03-03

Memory in machine learning 2021-03-03 – 2021-03-03

Convolutional Gaussian processes 2021-03-01

Stochastic processes on manifolds 2021-03-01

Auditory features descriptors, maps, representations for audio 2019-11-13 – 2021-01-14

Why does deep learning work? Are we in the pocket of Big VRAM? 2017-05-30 – 2020-12-14

Efficient factoring of GP likelihoods 2020-10-16 – 2020-10-26

GP inducing features 2020-10-16 – 2020-10-26

GP inducing variables 2020-10-16 – 2020-10-26

Localized Gaussian processes 2020-10-16 – 2020-10-26

Audiovisuals Synesthetic and other cross-media audio stunts 2020-10-26

Big data ML best practice 2020-09-16 – 2020-09-21

Data dimensionality reduction Wherein I teach myself, amongst other things, feature selection, how a sparse PCA works, and decide where to file multidimensional scaling 2015-03-22 – 2020-09-11

Neural nets Designing the fanciest usable differentiable loss surface 2016-10-14 – 2020-09-09

Causal graphical model reading group 2020 An introduction to conditional independence DAGs and their use for causal inference. 2020-08-30 – 2020-09-03

Causal Bayesian networks Staged tree models, probability trees …Causalan Bayesian networks 2020-11-01 – 2020-09-01

Emulators and surrogate models via ML Shortcuts in scientific simulation using ML 2020-08-12 – 2020-08-26

Bushfire models 2020-09-07 – 2020-08-19

Learning of manifolds Also topological data analysis; other hip names to follow 2014-08-19 – 2020-06-23

Deep fakery 2020-06-15

Directed graphical models 2017-09-20 – 2020-05-13

Analysis/resynthesis of audio 2016-01-15 – 2020-04-09

Teaching computers to write music 2016-06-06 – 2020-03-25

Learnable indexes and hashes 2018-01-12 – 2020-02-18

Learning in adaptive systems On staring into scopophilic abysses 2019-10-19 – 2020-01-22

Controllerism Making thing happen by waving your arms about on stage 2014-11-17 – 2019-12-10

Audio source separation 2019-11-04 – 2019-11-26

Tunings 2015-10-29 – 2019-11-18

Machine listening Statistical models for audio 2014-10-10 – 2019-11-12

ISMIR 2019 Music Nerds in Delft 2019-11-04 – 2019-11-09

Phase retrieval I’ve got the power. / Like the crack of the whip/ I snap attack/ Front to back 2017-01-16 – 2019-11-07

Undirected graphical models 2017-09-20 – 2019-10-28

Bio computing 2016-05-29 – 2019-10-14

Machine vision 2015-01-03 – 2018-11-14

Gesture recognition 2014-10-17 – 2018-11-12

Quantum-probabilistic graphical models 2017-08-07

Marketing psychology 2017-04-27 – 2017-05-29

Musical metrics and manifolds 2014-09-26 – 2017-03-27

Genetic algorithms 2011-04-06 – 2016-12-28

Greatest hits 2016-11-19 – 2016-12-12

UNSW Stats reading group 2016 - Causal DAGs An introduction to conditional independence DAGs and their use for causal data. 2016-10-17 – 2016-10-21

Inference from disorder 2016-10-19

Dynamical systems 2016-04-26 – 2016-07-27

Coarse graining 2014-11-11 – 2015-12-02

Pattern machine 2011-06-27 – 2015-11-24