How do science

What are methodology? Why paradigm shift?

Scientific institutions and mechanisms Descriptive and normative 2021-08-24 – 2023-12-08

Machine learning for partial differential equations 2017-05-15 – 2023-11-17

Feedback system identification, not necessarily linear Learning dynamics from data 2016-08-01 – 2023-11-15

Causal inference in highly parameterized ML 2020-09-18 – 2023-10-24

Learning under distribution shift Also transfer learning, covariate shift, transferable learning, domain adaptation, transportability etc 2020-10-17 – 2023-10-24

Physics-informed neural networks 2019-10-15 – 2023-10-19

Neural PDE operator learning Especially forward operators. Image-to-image regression, where the images encode a physical process. 2019-10-15 – 2023-10-19

Wicked tail risks x-risk, y-risk, jackpot, die-risk, 2015-04-30 – 2023-10-11

Probabilistic numerics 2023-07-13 – 2023-09-25

Machine learning for climate systems 2020-04-02 – 2023-09-25

Bayesian inference for misspecified models 2016-05-30 – 2023-09-20

Statistics and machine learning 2011-04-15 – 2023-09-13

Quarto Swiss army knife for hand-whittling scientific reports, slides and blogs 2022-05-01 – 2023-09-08

Zotero The adequate citation tool 2019-12-01 – 2023-09-04

Academic writing workflow Cranking the paper mill in the 21st century 2014-10-04 – 2023-09-04

Materials informatics Machine learning in condensed matter physics, chemistry and materials science 2023-08-01 – 2023-08-08

Science; Institution design for “Scientist, falsify thyself”. Peer review, academic incentives, credentials, evidence and funding… 2020-05-17 – 2023-08-07

Metis and .*-rationality High modernism, spontaneous order, legibility, the Great Society, technocracy, local knowledge 2017-07-24 – 2023-08-04

Ablation studies and lesion studies In order to understand it we must be able to break it 2016-10-26 – 2023-08-01

M-open, M-complete, M-closed 2016-05-30 – 2023-07-23

Hydra for tracking machine learning experiments 2021-10-20 – 2023-07-19

Hypothesis tests, statistical 2014-08-23 – 2023-07-18

Codebraid Minimalist scientific workbook 2023-07-14

Blogdown Plus other RMarkdown-derived scholarly blogging systems 2020-08-26 – 2023-07-09

Research discovery Has someone answered that question I have not worked out how to ask yet? 2019-01-22 – 2023-06-06

Bayesian model calibration 2017-04-11 – 2023-06-01

Neural learning dynamical systems 2018-08-13 – 2023-05-23

Saying “Bayes” is not enough The other secret steps to doing Bayesian statistics 2016-05-30 – 2023-05-19

Differentiable PDE solvers 2017-05-15 – 2023-05-15

Hyperparameter optimization Replacing a hyperparameter problem with a hyperhyperparameter problem which feels like progress 2020-09-25 – 2023-05-12

Academic publishing 2015-07-07 – 2023-05-01

Dynamics of recommender systems and other AI social interventions at societal scale Variational approximations to high modernism 2023-07-03 – 2023-04-26

Quantified self Instrumentation and analytics for body and soul. Punk DIY precision medicine. 2022-01-11 – 2023-04-24

Legibility and automation Variational approximations to high modernism as AI modernism 2017-07-24 – 2023-04-22

ΦFlow A modern python computational fluid dynamics library for ML research 2022-06-24 – 2023-04-17

Hugo Lightweight static site utility 2020-08-26 – 2023-03-11

External validity When does what I learn on one data set apply to another? 2020-10-17 – 2023-02-16

Research data sharing 2017-05-31 – 2023-01-16

BibLaTeX Also BibTeX if you must 2020-09-29 – 2022-12-23

Machine learning for physical sciences Turbulent mixing at the boundary between disciplines with differing inertia and viscosity 2017-05-15 – 2022-12-07

Adverse advice selection 2022-01-25 – 2022-11-15

Hamiltonian and Langevin Monte Carlo Physics might be on to something 2018-07-31 – 2022-11-14

Explorables and interactives Between exploratory data analysis and games 2020-03-12 – 2022-11-07

Interaction effects and subgroups are probably what we want to estimate 2022-01-25 – 2022-11-06

Personalized medicine Precision medicine 2022-01-25 – 2022-11-06

Scientific writing In which tips are given for the projection of status through nominal phrases and passive voice 2014-12-31 – 2022-11-06

Deep learning as a dynamical system 2018-08-13 – 2022-10-30

Casual anthropic principles Convenience-sampling lived human experience 2020-02-15 – 2022-10-28

Tribal sorting and polarization Polarization and fragmentation by browser cookies 2017-02-12 – 2022-10-08

Social organisation of knowledge Descriptive and normative 2021-08-24 – 2022-10-07

The blogosphere Now with added newsletter-o-sphere 2014-12-29 – 2022-10-06

Multi level marketing Pyramid schemes, Ponzi schemes, Newcomb unboxing 2022-10-02 – 2022-10-02

Soft methodology of science 2012-01-13 – 2022-09-06

Bayes linear methods some kind of approximate Bayes thing 2022-08-17 – 2022-08-18

Tensorboard 2020-10-23 – 2022-08-10

Tracking experiments in machine learning 2020-10-23 – 2022-08-08

Academic blogging workflow Minimising the friction of advertising my thoughts in order to maximise the chance each thought gets advertised. Not covered: maximising quality of thoughts. 2020-05-22 – 2022-08-07

Causal inference on DAGs Confounding! This scientist performed a miracle graph surgery intervention and you won’t believe what happened next 2016-10-26 – 2022-08-06

Instumental variables and two stage regression Confounding! This scientist performed a miracle graph surgery intervention and you won’t believe what happened next 2016-10-26 – 2022-08-06

Mechanism design for reputation systems Karma, credit scores, pagerank, optimised ad hominem reasoning… 2014-08-05 – 2022-08-02

Bayes for beginners 2016-05-30 – 2022-07-23

Crowd-sourced science 2015-08-10 – 2022-05-17

knitr/RMarkdown etc 2020-02-02 – 2022-04-30

Farming and husbandry of black swans and dragon kings Heavy tailed and Knightian uncertainties for fun and profit 2020-09-22 – 2022-04-30

Causal graphical model reading group 2022 Causal inference 2022-04-01 – 2022-04-29

Generalized Bayesian Computation 2019-10-03 – 2022-04-28

Inference without KL divergence 2019-10-03 – 2022-04-28

This is a simulation Can the automaton learn to play the game of life? 2017-04-04 – 2022-04-09

Bayesian nonparametric statistics Updating more dimensions than datapoints 2016-05-30 – 2022-04-07

Digital scientific workbooks Literate coding for reality 2014-11-17 – 2022-03-31

Configuring machine learning experiments 2021-10-20 – 2022-03-09

Opinion dynamics 1: Social contagion moves hearts and minds How to win elections and influence people 2020-08-30 – 2022-03-03

Learning Gaussian processes which map functions to functions 2020-12-07 – 2022-02-25

Learning with conservation laws, invariances and symmetries 2020-04-11 – 2022-02-25

Reproducible research Open notebooks etc 2016-06-07 – 2022-02-15

Betting and prediction markets Market design for good guesses 2017-08-12 – 2022-02-15

Probabilistic programming Doing statistics using the tools of computer science 2019-10-02 – 2022-02-11

Phylogeny 2016-10-06 – 2022-02-05

Dunning-Kruger theory of mind On anthropomorphising humans 2020-06-18 – 2022-01-28

Learning on manifolds Finding the lowest bit of a krazy straw, from the inside 2011-10-21 – 2022-01-26

Feedback system identification, linear 2016-07-27 – 2022-01-21

Dunning-Kruger theory of institutions Lay theories of social mechanisms 2022-01-20

Dunning-Kruger theory of society Lay theories of groups 2022-01-20

Social psychology Which of those NPR-friendly studies actually replicated? 2017-02-20 – 2022-01-14

Causality via potential outcomes Neyman-Rubin, counterfactuals, conditional treatment effects, and related tricks 2016-10-26 – 2021-12-10

Pyro Approximate maximum in the density of probabilistic programming effort 2019-10-02 – 2021-11-25

First aid If you are checking this webpage while your colleague bleeds out, you are doing it wrong 2019-02-12 – 2021-10-22

Knowledge geometry 2012-05-23 – 2021-10-20

Planning under uncertainty Transcending planning-though-hope-and-haruspicy 2020-04-23 – 2021-10-10

Science for policy Using evidence and reason to govern ourselves 2011-08-07 – 2021-09-22

Software engineering for scientists 2016-06-07 – 2021-09-16

Meta learning Few-shot learning, learning fast weights, learning to learn 2021-09-16

Convolutional stochastic processes Moving averages of noise 2021-03-01 – 2021-08-16

Sequential experiments Especially multiple sequential experiments 2021-08-04

Publication bias Replication crises, P-values, bitching about journals, other debilities of contemporary science at large 2016-08-30 – 2021-07-22

Science History, sociology and philosophy thereof 2017-07-08 – 2021-07-21

Free will A matter about which I voluntarily admit I don’t care, but am compelled to have something to link to when eliding 2012-03-16 – 2021-04-23

Differentiable model selection Differentiable hyperparameter search, and architecture search, and optimisation optimisation by optimisation and so on 2020-09-25 – 2021-04-13

Convolutional Gaussian processes 2021-03-01

Stochastic processes on manifolds 2021-03-01

Bayesians vs frequentists Just because we both get the same answer doesn’t mean neither of us is wrong 2014-11-25 – 2021-01-14

Tracking experiments in science 2020-10-23 – 2020-11-06

Stan The flagship Bayesian workhorse 2020-10-19

Adaptive design of experiments Minesweeper++ 2017-04-11 – 2020-10-13

AutoML 2017-07-17 – 2020-10-02

Causal graphical model reading group 2020 An introduction to conditional independence DAGs and their use for causal inference. 2020-08-30 – 2020-09-03

Causal Bayesian networks Staged tree models, probability trees …Causalan Bayesian networks 2020-11-01 – 2020-09-01

Bushfire models 2020-09-07 – 2020-08-19

Citation management On PDFcocking 2014-09-08 – 2020-07-14

Selling uncertainty On the marginal price of ignorance 2016-05-25 – 2020-02-18

R Shiny Statistics through the internet 2020-02-11

Frequentist consistency of Bayesian methods TFW two flawed methods for understanding the world can agree with at least each other 2016-04-12 – 2019-10-19

Multiple testing 2015-04-22 – 2018-11-05

Sparse stochastic processes identification and sampling Discrete sample representation of sparse continuous stochastic processes 2018-11-22 – 2018-10-29

Feature engineering for research and science 2017-05-31 – 2018-04-27

Dynamical systems 2016-04-26 – 2016-07-27

Hidden variable formalisms in quantum mechanics 2015-11-28