Adaptive Forward Stepwise: A Method for High Sparsity Regression

Дата публикации: 17-08-2026 20:26:00

This paper proposes a sparse regression method that continuously interpolates between Forward Stepwise selection (FS) and the LASSO. When tuned appropriately, our solutions are much sparser than typical LASSO fits but, unlike FS fits, benefit from the stabilizing effect of shrinkage. Our method, Adaptive Forward Stepwise Regression (AFS) addresses the need for sparser models with shrinkage. We show its connection with boosting via a soft-thresholding viewpoint and demonstrate the ease of adapting the method to classification tasks. In both simulations and real data, our method has lower mean squared error and fewer selected features across multiple settings compared to popular sparse modeling procedures.

Схожие новости

#	Наименование новости	Тональность	Информативность	Дата публикации
1	Differentially Private Estimation and Inference in High-Dimensional Regression with FDR Control	0	7.94	17-08-2026
2	High-dimensional Parameter Transfer With Fused-Regularizer	0	9.38	17-08-2026
3	Near-optimal Delta-convex Estimation of Lipschitz Functions	0	9.71	17-08-2026
4	Semi-supervised learning for linear extremile regression	0	6.83	17-08-2026
5	A causal fused lasso for interpretable heterogeneous treatment effects estimation	0	3.7	17-08-2026
6	Stochastic Differential Equations models for Least-Squares Stochastic Gradient Descent	0	6.66	17-08-2026
7	Minimax Optimal Convergence of Gradient Descent in Logistic Regression via Large and Adaptive Stepsizes	0	7.52	17-08-2026
8	Inference with non-differentiable surrogate loss in a general high-dimensional classification framework	0	8.38	17-08-2026
9	Sparse Topic Modeling via Spectral Decomposition and Thresholding	0	9.18	17-08-2026

Классификация: Наука. Схожих патентов: 0. Схожих новостей: 9. Тональность: 0. Информативность: 5.6. Источник: jmlr.org.