Fast Lasso method for large-scale and ultrahigh-dimensional Cox model with applications to UK Biobank.

We develop a scalable and highly efficient algorithm to fit a Cox proportional hazard model by maximizing the $L^1$-regularized (Lasso) partial likelihood function, based on the Batch Screening Iterative Lasso (BASIL) method developed in Qian and others (2019). Our algorithm is particularly suitable...

Full description

Bibliographic Details
Published in:Biostatistics Vol. 23; no. 2; pp. 522 - 541
Main Authors: Li, Ruilin, Chang, Christopher, Justesen, Johanne M, Tanigawa, Yosuke, Qian, Junyang, Hastie, Trevor, Rivas, Manuel A, Tibshirani, Robert
Format: research Journal Article
Published: Oxford University Press / USA Apr2022
Online Access:View this record in EBSCOhost
Description
Summary:We develop a scalable and highly efficient algorithm to fit a Cox proportional hazard model by maximizing the $L^1$-regularized (Lasso) partial likelihood function, based on the Batch Screening Iterative Lasso (BASIL) method developed in Qian and others (2019). Our algorithm is particularly suitable for large-scale and high-dimensional data that do not fit in the memory. The output of our algorithm is the full Lasso path, the parameter estimates at all predefined regularization parameters, as well as their validation accuracy measured using the concordance index (C-index) or the validation deviance. To demonstrate the effectiveness of our algorithm, we analyze a large genotype-survival time dataset across 306 disease outcomes from the UK Biobank (Sudlow and others, 2015). We provide a publicly available implementation of the proposed approach for genetics data on top of the PLINK2 package and name it snpnet-Cox.