Transfer Learning via Regularized Random-effects Linear Discriminant Analysis

Дата публикации: 17-08-2026 20:26:00

Linear discriminant analysis is a widely used method for classification. However, the high dimensionality of predictors combined with small sample sizes often results in large classification errors. To address this challenge, it is crucial to leverage data from related source models to enhance the classification performance of a target model. This paper proposes a transfer learning approach via regularized random-effects linear discriminant analysis, where the discriminant direction is estimated as a weighted combination of ridge estimates obtained from both the target and source models. Multiple strategies for determining these weights are introduced and evaluated, including one that minimizes the estimation risk of the discriminant vector and another that minimizes the classification error. Utilizing results from random matrix theory, we explicitly derive the asymptotic values of these weights and the associated classification error rates in the high-dimensional setting, where the aspect ratio $\gamma := p/n$ as $p, n\rightarrow \infty$, with $p$ representing the predictor dimension and $n$ the sample size. Extensive numerical studies, including simulations, the analysis of the proteomics-based cardiovascular disease risk classification and the lipid traits classification problem with genotype data, demonstrate the effectiveness of the proposed approach.

Схожие новости

#	Наименование новости	Тональность	Информативность	Дата публикации
1	Inference with non-differentiable surrogate loss in a general high-dimensional classification framework	0	8.38	17-08-2026
2	Refined Risk Bounds for Unbounded Losses via Transductive Priors	0	5.33	17-08-2026
3	Semi-supervised learning for linear extremile regression	0	6.83	17-08-2026
4	Decorrelated Local Linear Estimator: Inference for Non-linear Effects in High-dimensional Additive Models	0	7.75	17-08-2026
5	Transfer Conformal Predictive Inference for Regression	0	5.02	17-08-2026
6	High-dimensional Parameter Transfer With Fused-Regularizer	0	9.38	17-08-2026
7	Differentially Private Estimation and Inference in High-Dimensional Regression with FDR Control	0	7.94	17-08-2026
8	Flexible Functional Treatment Effect Estimation	0	5.7	17-08-2026
9	Adaptive Nonparametric Perturbations of Parametric Models with Generalized Bayes	0	4.62	17-08-2026
10	A causal fused lasso for interpretable heterogeneous treatment effects estimation	0	3.7	17-08-2026

Классификация: Наука. Схожих патентов: 0. Схожих новостей: 10. Тональность: 0. Информативность: 5.98. Источник: jmlr.org.