Generalized Resubstitution for Regression Error Estimation

Дата публикации: 17-08-2026 20:26:00

We propose generalized resubstitution error estimators for regression. Each error estimator in this class corresponds to a choice of an empirical probability measure and a loss function. The standard empirical probability measure and the quadratic loss lead to the standard sum of squares error estimator. Other choices of empirical probability measure lead to more general estimators with superior bias and variance properties. We prove that these error estimators are consistent under broad assumptions. In addition, procedures for choosing the empirical measure based on the method of moments and maximum pseudo-likelihood are proposed and investigated. Detailed experimental results using polynomial regression demonstrate empirically the superior finite-sample bias and variance properties of the proposed estimators. The R code for the experiments is provided.

Схожие новости

#	Наименование новости	Тональность	Информативность	Дата публикации
1	The Distribution of Ridgeless Least Squares Interpolators	0	5.78	17-08-2026
2	Near-optimal Delta-convex Estimation of Lipschitz Functions	0	9.71	17-08-2026
3	Persistence Diagrams Estimation of Multivariate Piecewise H{\"o}lder-continuous Signals	0	6.3	17-08-2026
4	Semi-supervised learning for linear extremile regression	0	6.83	17-08-2026
5	Mixing times of data-augmentation Gibbs samplers for high-dimensional probit regression	0	8.78	17-08-2026
6	Simulation-based Calibration of Uncertainty Intervals under Approximate Bayesian Estimation	0	7.3	17-08-2026
7	Deconvolution in unlinked linear models	0	4.62	17-08-2026
8	High-dimensional Parameter Transfer With Fused-Regularizer	0	9.38	17-08-2026
9	Decorrelated Local Linear Estimator: Inference for Non-linear Effects in High-dimensional Additive Models	0	7.75	17-08-2026
10	Vector-Valued Gaussian Processes for Approximating Divergence- or Rotation-free Vector Fields	0	9	17-08-2026

Классификация: . Схожих патентов: 0. Схожих новостей: 10. Тональность: 0. Информативность: 4.2. Источник: jmlr.org.