# Bootstrap

Shuffling reality to produce your data

November 26, 2014 — January 27, 2022

Resampling your own data to estimate how good your point-estimator is, and to reduce its bias. In general an intuitive technique. However, gets tricky for e.g. dependent data. For a handy crib sheet for bootstrap failure modes, see Thomas Lumley, When the bootstrap doesn’t work.

In the classical mode, this is a frequentist technique without an immediate Bayesian interpretation.

Commonly credited as being invented by B. Efron (1979) and theoretically justified by Gine and Zinn (1990).

## 1 Teaching

## 2 Bootstrap bias correction

As opp variance estimation. NBD; Bootstrap is notionally telling you the sampling distribution. 🏗

## 3 Bootstrap for dependent data

e.g., as presaged, time series. Parametric bootstrap would be the logical default choice, right? When does that work?

## 4 Causal bootstrap

Now a thing! (Imbens and Menzel 2021)

## 5 As a Bayesian method

There is absolutely a Bayesian bootstrap if you think hard enough about it, it turns out. Several, really. Rubin (1981) derived a Bayesian version. See Lyddon, Holmes, and Walker (2019) for a modern update, and Rasmus Bååth for a diagrammed explanation of the points of contact with frequentist bootstrap and some other things.

## 6 Pedagogic

Tim Hesterberg’s teaching notes:

## 7 References

*Molecular Biology and Evolution*.

*arXiv:0901.3202 [Cs, Stat]*.

*The Annals of Statistics*.

*Journal of Econometrics*.

*Statistical Science*.

*Computational Statistics & Data Analysis*.

*Sociological Methods & Research*.

*Biometrika*.

*Probability Theory and Related Fields*.

*Journal of the Korean Statistical Society*.

*Statistical Science*.

*The Annals of Statistics*.

*Biometrika*.

*The Annals of Applied Statistics*.

*Stats*.

*Biometrika*.

*Algorithms*.

*Annals of Probability*.

*arXiv:1907.12116 [Cs, Math, Stat]*.

*Journal of the Korean Statistical Society*.

*Journal of Econometrics*.

*Resampling Methods: A Practical Guide to Data Analysis*.

*The Annals of Statistics*.

*arXiv:1711.00813 [Stat]*.

*The Annals of Statistics*.

*Handbook of Econometrics*.

*Biometrika*.

*International Statistical Review*.

*Wiley Interdisciplinary Reviews: Computational Statistics*.

*Bootstrap Methods and Their Application*.

*The Annals of Statistics*.

*The Annals of Statistics*.

*Statistics & Probability Letters*.

*Probability Theory and Related Fields*.

*Resampling Methods for Dependent Data*.

*Statistical Science*.

*Biometrika*.

*IEEE Transactions on Neural Networks*.

*arXiv:1409.4317 [Math, Stat]*.

*Statistical Science*.

*Journal of the American Statistical Association*.

*Econometric Reviews*.

*Journal of Time Series Analysis*.

*Annals of Statistics*.

*Clinical Psychological Science*.

*American Scientist*.

*Journal of the American Statistical Association*.

*Statistica Sinica*.

*Journal of the Royal Statistical Society. Series B (Methodological)*.

*arXiv:1506.06266 [Math, Stat]*.

*Water Resources Research*.

*Journal of Econometrics*.