Article

Regularization Methods for Fitting Linear Models with Small Sample Sizes: Fitting the Lasso Estimator using R

---

Abstract

Researchers and data analysts are sometimes faced with the problem of very small samples, where the number of variables approaches or exceeds the overall sample size; i.e. high dimensional data. In such cases, standard statistical models such as regression or analysis of variance cannot be used, either because the resulting parameter estimates exhibit very high variance and can therefore not be trusted, or because the statistical algorithm cannot converge on parameter estimates at all. There exist an alternative set of model estimation procedures, known collectively as regularization methods, which can be used in such circumstances, and which have been shown through simulation research to yield accurate parameter estimates. The purpose of this paper is to describe, for those unfamiliar with them, the most popular of these regularization methods, the lasso, and to demonstrate its use on an actual high dimensional dataset involving adults with autism, using the R software language. Results of analyses involving relating measures of executive functioning with a full scale intelligence test score are presented, and implications of using these models are discussed. Accessed 4,969 times on https://pareonline.net from May 08, 2016 to December 31, 2019. For downloads from January 1, 2020 forward, please click on the PlumX Metrics link to the right.

Keywords: Educational Research, Research Methodology, Statistical Analysis

How to Cite:

Finch, W. H. & Finch, M. E., (2016) “Regularization Methods for Fitting Linear Models with Small Sample Sizes: Fitting the Lasso Estimator using R”, Practical Assessment, Research, and Evaluation 21(1): 7. doi: https://doi.org/10.7275/jr3d-cq04