Indirect inference

A.k.a the auxiliary method. At the moment I am mostly using the sub-flavour of this called Approximate Bayesian Computation, so that notebook is rather more developed.

In the (older?) frequentist framing you can get through an undergraduate program in statistics without simulation based inference arising. However, I am pretty sure it is required for be economists and ecologists.

Quoting Cosma:

[…] your model is too complicated for you to appeal to any of the usual estimation methods of statistics. […] there is no way to even calculate the likelihood of a given data set \(x_1,x_2,…x_t\equiv x_t\) under parameters \(\theta\) in closed form, which would rule out even numerical likelihood maximization, to say nothing of Bayesian methods […] Yet you can simulate; it seems like there should be some way of saying whether the simulations look like the data. This is where indirect inference comes in […] Introduce a new model, called the “auxiliary model”, which is mis-specified and typically not even generative, but is easily fit to the data, and to the data alone. (By that last I mean that you don’t have to impute values for latent variables, etc., etc., even though you might know those variables exist and are causally important.) The auxiliary model has its own parameter vector \(\beta\), with an estimator \(\hat{\beta}\). These parameters describe aspects of the distribution of observables, and the idea of indirect inference is that we can estimate the generative parameters \(\theta\) by trying to match those aspects of observations, by trying to match the auxiliary parameters.

Aaron King’s lab at UMichigan stamped a lot of this research. One wonders whether the optimal summary statistic can be learned from the data. Apparently yes?.

I gather the pomp R package does some simulation-based inference, but I have not checked in for a while so there might be broader and/or fresher options.


Babtie, Ann C., Paul Kirk, and Michael P. H. Stumpf. 2014. Topological Sensitivity Analysis for Systems Biology.” Proceedings of the National Academy of Sciences 111 (52): 18507–12.
Batz, Philipp, Andreas Ruttor, and Manfred Opper. 2017. Approximate Bayes Learning of Stochastic Differential Equations.” arXiv:1702.05390 [Physics, Stat], February.
Bretó, Carles, Daihai He, Edward L. Ionides, and Aaron A. King. 2009. Time Series Analysis via Mechanistic Models.” The Annals of Applied Statistics 3 (1): 319–48.
Castro, Pablo de, and Tommaso Dorigo. 2019. INFERNO: Inference-Aware Neural Optimisation.” Computer Physics Communications 244 (November): 170–79.
Cauchemez, Simon, and Neil M. Ferguson. 2008. Likelihood-Based Estimation of Continuous-Time Epidemic Models from Time-Series Data: Application to Measles Transmission in London.” Journal of The Royal Society Interface 5 (25): 885–97.
Clark, James S., and Ottar N. Bjørnstad. 2004. Population Time Series: Process Variability, Observation Errors, Missing Values, Lags, and Hidden States.” Ecology 85 (11): 3140–50.
Commandeur, Jacques J. F., Siem Jan Koopman, and Marius Ooms. 2011. Statistical Software for State Space Methods.” Journal of Statistical Software 41 (1).
Cook, Alex R., Wilfred Otten, Glenn Marion, Gavin J. Gibson, and Christopher A. Gilligan. 2007. Estimation of Multiple Transmission Rates for Epidemics in Heterogeneous Populations.” Proceedings of the National Academy of Sciences 104 (51): 20392–97.
Corenflos, Adrien, James Thornton, George Deligiannidis, and Arnaud Doucet. 2021. Differentiable Particle Filtering via Entropy-Regularized Optimal Transport.” arXiv:2102.07850 [Cs, Stat], June.
Cox, D. R., and Christiana Kartsonaki. 2012. The Fitting of Complex Parametric Models.” Biometrika 99 (3): 741–47.
Creel, Michael, and Dennis Kristensen. 2012. Estimation of Dynamic Latent Variable Models Using Simulated Non-Parametric Moments.” The Econometrics Journal 15 (3): 490–515.
———. 2013. Indirect Likelihood Inference (Revised).” UFAE and IAE Working Paper 931.13. Unitat de Fonaments de l’Anàlisi Econòmica (UAB) and Institut d’Anàlisi Econòmica (CSIC).
Czellar, Veronika, and Elvezio Ronchetti. 2010. Accurate and Robust Tests for Indirect Inference.” Biometrika 97 (3): 621–30.
Dax, Maximilian, Jonas Wildberger, Simon Buchholz, Stephen R. Green, Jakob H. Macke, and Bernhard Schölkopf. 2023. Flow Matching for Scalable Simulation-Based Inference.” arXiv.
Dellaporta, Charita, Jeremias Knoblauch, Theodoros Damoulas, and François-Xavier Briol. 2022. Robust Bayesian Inference for Simulator-Based Models via the MMD Posterior Bootstrap.” arXiv:2202.04744 [Cs, Stat], February.
Dridi, Ramdan, Alain Guay, and Eric Renault. 2007. Indirect Inference and Calibration of Dynamic Stochastic General Equilibrium Models.” Journal of Econometrics, The interface between econometrics and economic theory, 136 (2): 397–430.
Efron, Bradley. 2010. The Future of Indirect Evidence.” Statistical Science 25 (2): 145–57.
Fong, Edwin, Simon Lyddon, and Chris Holmes. 2019. Scalable Nonparametric Sampling from Multimodal Posteriors with the Posterior Bootstrap.” arXiv:1902.03175 [Cs, Stat], August.
Gallant, A. Ronald, David Hsieh, and George Tauchen. 1997. Estimation of Stochastic Volatility Models with Diagnostics.” Journal of Econometrics 81 (1): 159–92.
Gallant, A. Ronald, and George Tauchen. 1996. Which Moments to Match? Econometric Theory 12 (04): 657–81.
Genton, Marc G, and Elvezio Ronchetti. 2003. Robust Indirect Inference.” Journal of the American Statistical Association 98 (461): 67–76.
Gourieroux, Christian, and Alain Monfort. 1993. Simulation-Based Inference: A Survey with Special Reference to Panel Data Models.” Journal of Econometrics 59 (1–2): 5–33.
Gourieroux, C., A. Monfort, and E. Renault. 1993. Indirect Inference.” Journal of Applied Econometrics 8 (December): S85–118.
He, Daihai, Edward L. Ionides, and Aaron A. King. 2010. Plug-and-Play Inference for Disease Dynamics: Measles in Large and Small Populations as a Case Study.” Journal of The Royal Society Interface 7 (43): 271–83.
Ionides, E. L., C. Bretó, and A. A. King. 2006. Inference for Nonlinear Dynamical Systems.” Proceedings of the National Academy of Sciences 103 (49): 18438–43.
Ionides, Edward L., Anindya Bhadra, Yves Atchadé, and Aaron King. 2011. Iterated Filtering.” The Annals of Statistics 39 (3): 1776–1802.
Jiang, Wenxin, and Bruce Turnbull. 2004. The Indirect Method: Inference Based on Intermediate Statistics—A Synthesis and Examples.” Statistical Science 19 (2): 239–63.
Kendall, Bruce E., Stephen P. Ellner, Edward McCauley, Simon N. Wood, Cheryl J. Briggs, William W. Murdoch, and Peter Turchin. 2005. Population Cycles in the Pine Looper Moth: Dynamical Tests of Mechanistic Hypotheses.” Ecological Monographs 75 (2): 259–76.
Lueckmann, Jan-Matthis, Jan Boelts, David S. Greenberg, Pedro J. Gonçalves, and Jakob H. Macke. 2021. Benchmarking Simulation-Based Inference.” In AISTATS.
Lyddon, Simon, Stephen Walker, and Chris Holmes. 2018. Nonparametric Learning from Bayesian Models with Randomized Objective Functions.” In Proceedings of the 32nd International Conference on Neural Information Processing Systems, 2075–85. NIPS’18. Red Hook, NY, USA: Curran Associates Inc.
Matsubara, Takuo, Jeremias Knoblauch, François-Xavier Briol, and Chris J. Oates. 2021. Robust Generalised Bayesian Inference for Intractable Likelihoods.” arXiv:2104.07359 [Math, Stat], April.
Nickl, Richard, and Benedikt M. Pötscher. 2009. Efficient Simulation-Based Minimum Distance Estimation and Indirect Inference.” Mathematical Methods of Statistics 19, August, 327–64.
Nott, David J., Christopher Drovandi, and David T. Frazier. 2023. Bayesian Inference for Misspecified Generative Models.” arXiv.
Nott, David J., Lucy Marshall, and Tran Minh Ngoc. 2012. The Ensemble Kalman Filter Is an ABC Algorithm.” Statistics and Computing 22 (6): 1273–76.
Pacchiardi, Lorenzo, and Ritabrata Dutta. 2022. Generalized Bayesian Likelihood-Free Inference Using Scoring Rules Estimators.” arXiv:2104.03889 [Stat], March.
Roberts, G. O., and O. Stramer. 2001. On Inference for Partially Observed Nonlinear Diffusion Models Using the Metropolis–Hastings Algorithm.” Biometrika 88 (3): 603–21.
Schmon, Sebastian M., Patrick W. Cannon, and Jeremias Knoblauch. 2021. Generalized Posteriors in Approximate Bayesian Computation.” arXiv:2011.08644 [Stat], February.
Shi, Jiaxin, Shengyang Sun, and Jun Zhu. 2018. A Spectral Approach to Gradient Estimation for Implicit Distributions.” In. arXiv.
Smith, A A. 2008. Indirect Inference.” In The New Palgrave Dictionary of Economics. Palgrave Macmillan.
Smith, A. A. 1993. Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions.” Journal of Applied Econometrics 8 (S1): S63–84.
Wood, Simon N. 2010. Statistical Inference for Noisy Nonlinear Ecological Dynamic Systems.” Nature 466 (7310): 1102–4.
Zhu, Wanchuang, and Yanan Fan. 2022. A Synthetic Likelihood Approach for Intractable Markov Random Fields.” Computational Statistics, July.

No comments yet. Why not leave one?

GitHub-flavored Markdown & a sane subset of HTML is supported.