--- references: - id: AlonBoosting2020 accessed: - year: 2021 month: 2 day: 25 author: - family: Alon given: Noga - family: Gonen given: Alon - family: Hazan given: Elad - family: Moran given: Shay citation-key: AlonBoosting2020 container-title: arXiv:2001.11704 [cs, stat] issued: - year: 2020 month: 5 day: 5 title: Boosting Simple Learners type: article-journal URL: http://arxiv.org/abs/2001.11704 - id: AlquierUserfriendly2021 accessed: - year: 2021 month: 10 day: 26 author: - family: Alquier given: Pierre citation-key: AlquierUserfriendly2021 container-title: arXiv:2110.11216 [cs, math, stat] issued: - year: 2021 month: 10 day: 21 title: User-friendly introduction to PAC-Bayes bounds type: article-journal URL: http://arxiv.org/abs/2110.11216 - id: AtheyEstimating2019 accessed: - year: 2022 month: 3 day: 3 author: - family: Athey given: Susan - family: Wager given: Stefan citation-key: AtheyEstimating2019 container-title: arXiv:1902.07409 [stat] issued: - year: 2019 month: 2 day: 20 language: en title: 'Estimating Treatment Effects with Causal Forests: An Application' type: article-journal URL: http://arxiv.org/abs/1902.07409 - id: AtheyGeneralized2019 accessed: - year: 2020 month: 6 day: 6 author: - family: Athey given: Susan - family: Tibshirani given: Julie - family: Wager given: Stefan citation-key: AtheyGeneralized2019 container-title: Annals of Statistics container-title-short: Ann. Statist. DOI: 10.1214/18-AOS1709 ISSN: 0090-5364, 2168-8966 issue: '2' issued: - year: 2019 month: 4 language: EN page: 1148-1178 publisher: Institute of Mathematical Statistics title: Generalized random forests type: article-journal URL: http://arxiv.org/abs/1610.01271 volume: '47' - id: BalogMondrian2015 accessed: - year: 2015 month: 8 day: 6 author: - family: Balog given: Matej - family: Teh given: Yee Whye citation-key: BalogMondrian2015 container-title: arXiv:1507.05181 [cs, stat] issued: - year: 2015 month: 7 day: 18 title: The Mondrian Process for Machine Learning type: article-journal URL: http://arxiv.org/abs/1507.05181 - id: BalogMondrian2016 accessed: - year: 2016 month: 6 day: 21 author: - family: Balog given: Matej - family: Lakshminarayanan given: Balaji - family: Ghahramani given: Zoubin - family: Roy given: Daniel M. - family: Teh given: Yee Whye citation-key: BalogMondrian2016 container-title: arXiv:1606.05241 [stat] issued: - year: 2016 month: 6 day: 16 title: The Mondrian Kernel type: article-journal URL: http://arxiv.org/abs/1606.05241 - id: BickelRegularization2006 accessed: - year: 2014 month: 11 day: 24 author: - family: Bickel given: Peter J. - family: Li given: Bo - family: Tsybakov given: Alexandre B. - family: Geer given: Sara A. non-dropping-particle: van de - family: Yu given: Bin - family: Valdés given: Teófilo - family: Rivero given: Carlos - family: Fan given: Jianqing - family: Vaart given: Aad dropping-particle: van der citation-key: BickelRegularization2006 container-title: Test container-title-short: Test DOI: 10.1007/BF02607055 ISSN: 1133-0686, 1863-8260 issue: '2' issued: - year: 2006 month: 9 day: 1 language: en page: 271-344 title: Regularization in statistics type: article-journal URL: http://oz.berkeley.edu/~bickel/Test_BickelLi.pdf volume: '15' - id: BreimanArcing1997 author: - family: Breiman given: Leo citation-key: BreimanArcing1997 issued: - year: 1997 publisher: Statistics Department, University of California, Berkeley title: Arcing the Edge type: report URL: https://statistics.berkeley.edu/sites/default/files/tech-reports/486.pdf - id: BreimanBagging1996 accessed: - year: 2015 month: 4 day: 5 author: - family: Breiman given: Leo citation-key: BreimanBagging1996 container-title: Machine Learning container-title-short: Mach Learn DOI: 10.1007/BF00058655 ISSN: 0885-6125, 1573-0565 issue: '2' issued: - year: 1996 month: 8 day: 1 language: en page: 123-140 title: Bagging predictors type: article-journal volume: '24' - id: BuhlmannStatistics2011 author: - family: Bühlmann given: Peter - family: Geer given: Sara non-dropping-particle: van de citation-key: BuhlmannStatistics2011 edition: 2011 edition event-place: Heidelberg ; New York ISBN: 978-3-642-20191-2 issued: - year: 2011 month: 6 day: 8 language: English number-of-pages: '558' publisher: Springer publisher-place: Heidelberg ; New York title: 'Statistics for High-Dimensional Data: Methods, Theory and Applications' type: book - id: ChipmanBART2010 accessed: - year: 2018 month: 3 day: 23 author: - family: Chipman given: Hugh A. - family: George given: Edward I. - family: McCulloch given: Robert E. citation-key: ChipmanBART2010 container-title: The Annals of Applied Statistics DOI: 10.1214/09-AOAS285 ISSN: 1932-6157 issue: '1' issued: - year: 2010 month: 3 language: en page: 266-298 publisher: Institute of Mathematical Statistics title: 'BART: Bayesian additive regression trees' type: article-journal volume: '4' - id: ClarkeComparing2003 accessed: - year: 2021 month: 8 day: 6 author: - family: Clarke given: Bertrand citation-key: ClarkeComparing2003 container-title: The Journal of Machine Learning Research container-title-short: J. Mach. Learn. Res. DOI: 10.1162/153244304773936090 ISSN: 1532-4435 issue: 'null' issued: - year: 2003 month: 12 day: 1 page: 683–712 title: >- Comparing Bayes model averaging and stacking when model approximation error cannot be ignored type: article-journal volume: '4' - id: CriminisiDecision2012 author: - family: Criminisi given: Antonio - family: Shotton given: Jamie - family: Konukoglu given: Ender citation-key: CriminisiDecision2012 DOI: 10.1561/0600000035 issued: - year: 2012 language: en title: >- Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning type: book URL: http://research.microsoft.com/apps/pubs/default.aspx?id=158806 volume: '7' - id: CurthWhy2024 accessed: - year: 2024 month: 3 day: 7 author: - family: Curth given: Alicia - family: Jeffares given: Alan - family: Schaar given: Mihaela non-dropping-particle: van der citation-key: CurthWhy2024 DOI: 10.48550/arXiv.2402.01502 issued: - year: 2024 month: 2 day: 2 number: arXiv:2402.01502 publisher: arXiv title: >- Why do Random Forests Work? Understanding Tree Ensembles as Self-Regularizing Adaptive Smoothers type: article URL: http://arxiv.org/abs/2402.01502 - id: DavisModeling2020 accessed: - year: 2020 month: 11 day: 19 author: - family: Davis given: Richard A. - family: Nielsen given: Mikkel S. citation-key: DavisModeling2020 container-title: Electronic Journal of Statistics container-title-short: Electron. J. Statist. DOI: 10.1214/20-EJS1758 ISSN: 1935-7524 issue: '2' issued: - year: 2020 language: EN page: 3644-3671 publisher: The Institute of Mathematical Statistics and the Bernoulli Society title: 'Modeling of time series using random forests: Theoretical developments' type: article-journal volume: '14' - id: DiazAvalosSimilarity2012 accessed: - year: 2015 month: 2 day: 3 author: - family: Díaz-Avalos given: Carlos - family: Juan given: P. - family: Mateu given: J. citation-key: DiazAvalosSimilarity2012 container-title: Stochastic Environmental Research and Risk Assessment container-title-short: Stoch Environ Res Risk Assess DOI: 10.1007/s00477-012-0654-1 ISSN: 1436-3240, 1436-3259 issue: '5' issued: - year: 2012 month: 10 day: 25 language: en page: 1193-1205 title: >- Similarity measures of conditional intensity functions to test separability in multidimensional point processes type: article-journal volume: '27' - id: EfronResampling2021 accessed: - year: 2023 month: 1 day: 11 author: - family: Efron given: Bradley citation-key: EfronResampling2021 container-title: Stats DOI: 10.3390/stats4040063 ISSN: 2571-905X issue: '4' issued: - year: 2021 month: 12 language: en number: '4' page: 1091-1115 publisher: Multidisciplinary Digital Publishing Institute title: Resampling Plans and the Estimation of Prediction Error type: article-journal URL: https://www.mdpi.com/2571-905X/4/4/63 volume: '4' - id: FernandezDelgadoWe2014 accessed: - year: 2015 month: 5 day: 21 author: - family: Fernández-Delgado given: Manuel - family: Cernadas given: Eva - family: Barro given: Senén - family: Amorim given: Dinani citation-key: FernandezDelgadoWe2014 container-title: Journal of Machine Learning Research ISSN: 1532-4435 issue: '1' issued: - year: 2014 month: 1 page: 3133–3181 title: >- Do We Need Hundreds of Classifiers to Solve Real World Classification Problems? type: article-journal URL: http://jmlr.org/papers/v15/delgado14a.html volume: '15' - id: FriedmanAdditive2000 accessed: - year: 2014 month: 10 day: 29 author: - family: Friedman given: Jerome - family: Hastie given: Trevor - family: Tibshirani given: Robert citation-key: FriedmanAdditive2000 container-title: The Annals of Statistics container-title-short: Ann. Statist. DOI: 10.1214/aos/1016218223 ISSN: 0090-5364, 2168-8966 issue: '2' issued: - year: 2000 month: 4 language: EN page: 337-407 title: >- Additive logistic regression: a statistical view of boosting (With discussion and a rejoinder by the authors) type: article-journal volume: '28' - id: FriedmanGreedy2001 accessed: - year: 2020 month: 3 day: 20 author: - family: Friedman given: Jerome H. citation-key: FriedmanGreedy2001 container-title: The Annals of Statistics container-title-short: Ann. Statist. DOI: 10.1214/aos/1013203451 ISSN: 0090-5364, 2168-8966 issue: '5' issued: - year: 2001 month: 10 language: en page: 1189-1232 publisher: Institute of Mathematical Statistics title: 'Greedy function approximation: A gradient boosting machine.' type: article-journal volume: '29' - id: FriedmanStochastic2002 accessed: - year: 2014 month: 10 day: 29 author: - family: Friedman given: Jerome H. citation-key: FriedmanStochastic2002 collection-title: Nonlinear Methods and Data Mining container-title: Computational Statistics & Data Analysis container-title-short: Computational Statistics & Data Analysis DOI: 10.1016/S0167-9473(01)00065-2 ISSN: 0167-9473 issue: '4' issued: - year: 2002 month: 2 day: 28 page: 367-378 title: Stochastic gradient boosting type: article-journal URL: https://statweb.stanford.edu/~jhf/ftp/stobst.pdf volume: '38' - id: GallClassSpecific2013 accessed: - year: 2015 month: 7 day: 16 author: - family: Gall given: J. - family: Lempitsky given: V. citation-key: GallClassSpecific2013 collection-title: Advances in Computer Vision and Pattern Recognition container-title: Decision Forests for Computer Vision and Medical Image Analysis editor: - family: Criminisi given: A. - family: Shotton given: J. ISBN: 978-1-4471-4928-6 978-1-4471-4929-3 issued: - year: 2013 language: en page: 143-157 publisher: Springer London title: Class-Specific Hough Forests for Object Detection type: paper-conference URL: http://www.iai.uni-bonn.de/~gall/download/jgall_houghforest_cvpr09.pdf - id: GammermanHedging2007 author: - family: Gammerman given: Alexander - family: Vovk given: Vladimir citation-key: GammermanHedging2007 container-title: The Computer Journal DOI: 10.1093/comjnl/bxl065 issue: '2' issued: - year: 2007 page: 151-163 title: Hedging Predictions in Machine Learning type: article-journal volume: '50' - id: HazimehTree2020 accessed: - year: 2021 month: 5 day: 6 author: - family: Hazimeh given: Hussein - family: Ponomareva given: Natalia - family: Mol given: Petros - family: Tan given: Zhenyu - family: Mazumder given: Rahul citation-key: HazimehTree2020 issued: - year: 2020 month: 2 day: 18 language: en title: 'The Tree Ensemble Layer: Differentiability meets Conditional Computation' type: article-journal URL: https://arxiv.org/abs/2002.07772v2 - id: HintonDistilling2015 accessed: - year: 2020 month: 3 day: 22 author: - family: Hinton given: Geoffrey - family: Vinyals given: Oriol - family: Dean given: Jeff citation-key: HintonDistilling2015 container-title: arXiv:1503.02531 [cs, stat] issued: - year: 2015 month: 3 day: 9 title: Distilling the Knowledge in a Neural Network type: article-journal URL: http://arxiv.org/abs/1503.02531 - id: IranzadBoostS2021 accessed: - year: 2021 month: 2 day: 21 author: - family: Iranzad given: Reza - family: Liu given: Xiao - family: Chaovalitwongse given: W. Art - family: Hippe given: Daniel S. - family: Wang given: Shouyi - family: Han given: Jie - family: Thammasorn given: Phawis - family: Duan given: Chunyan - family: Zeng given: Jing - family: Bowen given: Stephen R. citation-key: IranzadBoostS2021 issued: - year: 2021 month: 1 day: 27 language: en title: >- Boost-S: Gradient Boosted Trees for Spatial Data and Its Application to FDG-PET Imaging Data type: article-journal URL: https://arxiv.org/abs/2101.11190v2 - id: JohnsonLearning2014 author: - family: Johnson given: R. - family: Zhang given: Tong citation-key: JohnsonLearning2014 container-title: IEEE Transactions on Pattern Analysis and Machine Intelligence DOI: 10.1109/TPAMI.2013.159 ISSN: 0162-8828 issue: '5' issued: - year: 2014 month: 5 page: 942-954 title: Learning Nonlinear Functions Using Regularized Greedy Forest type: article-journal URL: http://arxiv.org/abs/1109.0887 volume: '36' - id: KapelnerBartMachine2016 accessed: - year: 2020 month: 3 day: 21 author: - family: Kapelner given: Adam - family: Bleich given: Justin citation-key: KapelnerBartMachine2016 container-title: Journal of Statistical Software container-title-short: J. Stat. Soft. DOI: 10.18637/jss.v070.i04 ISSN: 1548-7660 issue: '4' issued: - year: 2016 language: en title: 'bartMachine: Machine Learning with Bayesian Additive Regression Trees' type: article-journal URL: http://www.jstatsoft.org/v70/i04/ volume: '70' - id: LakshminarayananMondrian2014 accessed: - year: 2015 month: 7 day: 16 author: - family: Lakshminarayanan given: Balaji - family: Roy given: Daniel M - family: Teh given: Yee Whye citation-key: LakshminarayananMondrian2014 container-title: Advances in Neural Information Processing Systems 27 editor: - family: Ghahramani given: Z. - family: Welling given: M. - family: Cortes given: C. - family: Lawrence given: N. D. - family: Weinberger given: K. Q. issued: - year: 2014 page: 3140–3148 publisher: Curran Associates, Inc. title: 'Mondrian Forests: Efficient Online Random Forests' type: paper-conference URL: >- http://papers.nips.cc/paper/5234-mondrian-forests-efficient-online-random-forests.pdf - id: LeModel2022 accessed: - year: 2022 month: 7 day: 23 author: - family: Le given: Tri M. - family: Clarke given: Bertrand S. citation-key: LeModel2022 container-title: Journal of Machine Learning Research ISSN: 1533-7928 issue: '33' issued: - year: 2022 page: 1-53 title: Model Averaging Is Asymptotically Better Than Model Selection For Prediction type: article-journal URL: http://jmlr.org/papers/v23/20-874.html volume: '23' - id: MasonBoosting1999 accessed: - year: 2020 month: 3 day: 20 author: - family: Mason given: Llew - family: Baxter given: Jonathan - family: Bartlett given: Peter - family: Frean given: Marcus citation-key: MasonBoosting1999 collection-title: NIPS'99 container-title: >- Proceedings of the 12th International Conference on Neural Information Processing Systems event-place: Denver, CO ISBN: http://papers.nips.cc/paper/1766-boosting-algorithms-as-gradient-descent.pdf issued: - year: 1999 month: 11 day: 29 page: 512–518 publisher: MIT Press publisher-place: Denver, CO title: Boosting algorithms as gradient descent type: paper-conference - id: MeinshausenQuantile2006 accessed: - year: 2021 month: 2 day: 16 author: - family: Meinshausen given: Nicolai citation-key: MeinshausenQuantile2006 container-title: Journal of Machine Learning Research ISSN: 1533-7928 issue: '35' issued: - year: 2006 page: 983-999 title: Quantile Regression Forests type: article-journal URL: http://jmlr.org/papers/v7/meinshausen06a.html volume: '7' - id: MentchRandomization2020 accessed: - year: 2020 month: 9 day: 17 author: - family: Mentch given: Lucas - family: Zhou given: Siyu citation-key: MentchRandomization2020 container-title: Journal of Machine Learning Research ISSN: 1533-7928 issue: '171' issued: - year: 2020 page: 1-36 title: >- Randomization as Regularization: A Degrees of Freedom Explanation for Random Forest Success type: article-journal URL: http://jmlr.org/papers/v21/19-905.html volume: '21' - id: MinkaBayesian2002 accessed: - year: 2021 month: 8 day: 6 author: - family: Minka given: Thomas P. citation-key: MinkaBayesian2002 issued: - year: 2002 title: Bayesian model averaging is not model combination type: article URL: >- http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.362.4927&rep=rep1&type=pdf - id: NockBoosted2020 accessed: - year: 2020 month: 9 day: 8 author: - family: Nock given: Richard - family: Henecka given: Wilko citation-key: NockBoosted2020 container-title: arXiv:2001.09384 [cs, stat] issued: - year: 2020 month: 2 day: 3 title: Boosted and differentially private ensembles of decision trees type: article-journal URL: http://arxiv.org/abs/2001.09384 - id: RahimiWeighted2009 accessed: - year: 2015 month: 5 day: 19 author: - family: Rahimi given: Ali - family: Recht given: Benjamin citation-key: RahimiWeighted2009 container-title: Advances in neural information processing systems issued: - year: 2009 page: 1313–1320 publisher: Curran Associates, Inc. title: >- Weighted Sums of Random Kitchen Sinks: Replacing minimization with randomization in learning type: paper-conference URL: >- http://papers.nips.cc/paper/3495-weighted-sums-of-random-kitchen-sinks-replacing-minimization-with-randomization-in-learning - id: RamchandranEnsembling2021 accessed: - year: 2022 month: 2 day: 14 author: - family: Ramchandran given: Maya - family: Mukherjee given: Rajarshi citation-key: RamchandranEnsembling2021 container-title: arXiv:2106.02589 [math, stat] issued: - year: 2021 month: 6 day: 4 title: >- On Ensembling vs Merging: Least Squares and Random Forests under Covariate Shift type: article-journal URL: http://arxiv.org/abs/2106.02589 - id: SchapireBoosting1998 accessed: - year: 2015 month: 9 day: 23 author: - family: Schapire given: Robert E. - family: Freund given: Yoav - family: Bartlett given: Peter - family: Lee given: Wee Sun citation-key: SchapireBoosting1998 container-title: The Annals of Statistics container-title-short: Ann. Statist. DOI: 10.1214/aos/1024691352 ISSN: 0090-5364, 2168-8966 issue: '5' issued: - year: 1998 month: 10 page: 1651-1686 title: >- Boosting the margin: a new explanation for the effectiveness of voting methods type: article-journal volume: '26' - id: ScornetAsymptotics2014 accessed: - year: 2015 month: 1 day: 21 author: - family: Scornet given: Erwan citation-key: ScornetAsymptotics2014 container-title: arXiv:1409.2090 [math, stat] issued: - year: 2014 month: 9 day: 7 title: On the asymptotics of random forests type: article-journal URL: http://arxiv.org/abs/1409.2090 - id: ScornetConsistency2014 accessed: - year: 2015 month: 1 day: 21 author: - family: Scornet given: Erwan - family: Biau given: Gérard - family: Vert given: Jean-Philippe citation-key: ScornetConsistency2014 container-title: arXiv:1405.2881 [math, stat] issued: - year: 2014 month: 5 day: 12 title: Consistency of Random Forests type: article-journal URL: http://arxiv.org/abs/1405.2881 - id: ShottonDecision2013 author: - family: Shotton given: Jamie - family: Sharp given: Toby - family: Kohli given: Pushmeet - family: Nowozin given: Sebastian - family: Winn given: John - family: Criminisi given: Antonio citation-key: ShottonDecision2013 container-title: NIPS issued: - year: 2013 title: 'Decision Jungles: Compact and Rich Models for Classification' type: paper-conference URL: http://research.microsoft.com/apps/pubs/default.aspx?id=205439 - id: ShwartzZivTabular2021 accessed: - year: 2021 month: 6 day: 16 author: - family: Shwartz-Ziv given: Ravid - family: Armon given: Amitai citation-key: ShwartzZivTabular2021 container-title: arXiv:2106.03253 [cs] issued: - year: 2021 month: 6 day: 6 language: en title: 'Tabular data: Deep learning is not all you need' type: article-journal URL: http://arxiv.org/abs/2106.03253 - id: ZhangGPUacceleration2017 accessed: - year: 2021 month: 7 day: 2 author: - family: Zhang given: Huan - family: Si given: Si - family: Hsieh given: Cho-Jui citation-key: ZhangGPUacceleration2017 container-title: arXiv:1706.08359 [cs, stat] issued: - year: 2017 month: 6 day: 26 title: GPU-acceleration for Large-scale Tree Boosting type: article-journal URL: http://arxiv.org/abs/1706.08359 ...