Arnold Library

Structured penalties for functional linear models—partially empirical eigenvectors for regression

Randolph, Timothy W. and Harezlak, Jaroslaw and Feng, Ziding (2012) Structured penalties for functional linear models—partially empirical eigenvectors for regression. Electronic Journal of Statistics, 6. pp. 323-353. ISSN 1935-7524

[thumbnail of RandolphT_EJS_March2012.pdf]
RandolphT_EJS_March2012.pdf - Published Version
Available under License Creative Commons Attribution.

Download (567kB) | Preview
Article URL:


One of the challenges with functional data is incorporating geometric structure, or local correlation, into the analysis. This structure is inherent in the output from an increasing number of biomedical technologies, and a functional linear model is often used to estimate the relationship between the predictor functions and scalar responses. Common approaches to the problem of estimating a coefficient function typically involve two stages: regularization and estimation. Regularization is usually done via dimension reduction, projecting onto a predefined span of basis functions or a reduced set of eigenvectors (principal components). In contrast, we present a unified approach that directly incorporates geometric structure into the estimation process by exploiting the joint eigenproperties of the predictors and a linear penalty operator. In this sense, the components in the regression are ‘partially empirical’ and the framework is provided by the generalized singular value decomposition (GSVD). The form of the penalized estimation is not new, but the GSVD clarifies the process and informs the choice of penalty by making explicit the joint influence of the penalty and predictors on the bias, variance and performance of the estimated coefficient function. Laboratory spectroscopy data and simulations are used to illustrate the concepts.

Item Type: Article or Abstract
Additional Information: For IMS statement of Creative Commons copyright license, visit:
DOI: doi:10.1214/12-EJS676
Grant Numbers: R01-CA126205, P01-CA053996, U01-CA086368, R01- NS036524, U01-MH083545
Subjects: Research Methodologies > Mathematics and statistics
Depositing User: Library Staff
Date Deposited: 03 Apr 2012 19:24
Last Modified: 04 Apr 2012 00:03

Repository Administrators Only

View Item View Item