Toggle Accessibility Tools

Colloquium - Lucas Mentch

Institution: University of Pittsburgh
Title: Random Forests: Why They Work and Why That's a Problem
Date: October 19, 2021
Location: Zoom (Click here for meeting details)
Time: 10:20 AM - 11:10 AM Eastern Time

Abstract:
Random forests remain among the most popular off-the-shelf supervised machine learning tools with a well-established track record of predictive accuracy in both regression and classification settings.  Despite their empirical success, a full and satisfying explanation for their success has yet to be put forth. In this talk, we will show that the additional randomness injected into individual trees serves as a form of implicit regularization, making random forests an ideal model in low signal-to-noise ratio (SNR) settings. From a model-complexity perspective, this means that the mtry parameter in random forests serves much the same purpose as the shrinkage penalty in explicit regularization procedures like the lasso.  Realizing this, we demonstrate that alternative forms of randomness can provide similarly beneficial stabilization.  In particular, we show that augmenting the feature space with additional features consisting of only random noise can substantially improve the predictive accuracy of the model.  This surprising fact has been largely overlooked within the statistics community, but has crucial implications for thinking about how best to define and measure variable importance.  Numerous demonstrations on both real and synthetic data are provided.

Click here to view the colloquium flyer

news

July 22, 2021 MSU statistician attains uncommon Institute of Mathematical Statistics "Annals quadfecta" status

MSU statistician attains uncommon Institute of Mathematical Statistics "Annals quadfecta" status

June 24, 2021 STT presents William L. Harkness Award to PhD student

PhD student Nilanjan Chakraborty was recently presented with the William L. Harkness Award for outstanding teaching by a graduate student.

May 20, 2021 STT Undergraduate Student Andrew McDonald Awarded Goldwater Scholarship

Mr. Andrew McDonald, an Honors College junior majoring in Computer Science in the College of Engineering; and Statistics, and Advanced Mathematics in the College of Natural Science, has been named a recipient of the nationally competitive Barry M. Goldwater Scholarship.

upcoming events

Colloquium - Sam Pimentel

Institution: University of California, Berkeley
Title: [TBA]
Date: November 2, 2021
Location: Zoom (Click here for meeting details)
Time: 10:20 AM - 11:10 AM Eastern Time

Colloquium - Jordan Awan

Institution: Purdue University
Title: [TBA]
Date: November 16, 2021
Location: Zoom (Click here for meeting details)
Time: 10:20 AM - 11:10 AM Eastern Time

Colloquium - Edgar Dobriban

Institution: University of Pennsylvania
Title: [TBA]
Date: November 23, 2021
Location: Zoom (Click here for meeting details)
Time: 10:20 AM - 11:10 AM Eastern Time

Colloquium - Matthew Pratola

Institution: Ohio State University
Title: [TBA]
Date: November 30, 2021
Location: Zoom (Click here for meeting details)
Time: 10:20 AM - 11:10 AM Eastern Time