Building a robust linear model with forward selection and stepwise procedures

Subscribe to email list

Please select the email list(s) to which you wish to subscribe.

You are here

Building a robust linear model with forward selection and stepwise procedures

TitleBuilding a robust linear model with forward selection and stepwise procedures
Publication TypeJournal Article
Year of Publication2007
AuthorsKhan, JA, Van Aelst, S, Zamar, RH
JournalCOMPUTATIONAL STATISTICS & DATA ANALYSIS
Volume52
Pagination239-248
Date PublishedSEP 15
Type of ArticleArticle
ISSN0167-9473
Keywordscomputational complexity, pairwise robust correlation, robust model selection, stepwise algorithm
AbstractClassical step-by-step algorithms, such as forward selection (FS) and stepwise (SW) methods, are computationally suitable, but yield poor results when the data contain outliers and other contaminations. Robust model selection procedures, on the other hand, are not computationally efficient or scalable to large dimensions, because they require the fitting of a large number of submodels. Robust and computationally efficient versions of FS and SW are proposed. Since FS and SW can be expressed in terms of sample correlations, simple robustifications are obtained by replacing these correlations by their robust counterparts. A pairwise approach is used to construct the robust correlation matrix-not only because of its computational advantages over the d-dimensional approach, but also because the pairwise approach is more consistent with the idea of step-by-step algorithms. The proposed robust methods have much better performance compared to standard FS and SW. Also, they are computationally very suitable and scalable to large high-dimensional data sets. (c) 2007 Elsevier B.V. All rights reserved.
DOI10.1016/j.csda.2007.01.007