Near-optimal Delta-convex Estimation of Lipschitz Functions

Дата публикации: 17-08-2026 20:26:00

This paper presents a tractable algorithm for estimating an unknown Lipschitz function from noisy observations and establishes an upper bound on its convergence rate. The approach extends max-affine methods from convex shape-restricted regression to the more general Lipschitz setting. A key component is a nonlinear feature expansion that maps max-affine functions into a subclass of delta-convex functions, which act as universal approximators of Lipschitz functions while preserving their Lipschitz constants. Leveraging this property, the estimator attains the minimax convergence rate (up to logarithmic factors) with respect to the intrinsic dimension of the data under squared loss and subgaussian distributions in the random design setting. The algorithm integrates adaptive partitioning to capture intrinsic dimension, a penalty-based regularization mechanism that removes the need to know the true Lipschitz constant, and a two-stage optimization procedure combining a convex initialization with local refinement. The framework is also straightforward to adapt to convex shape-restricted regression. Experiments demonstrate competitive performance relative to other theoretically justified methods, including nearest-neighbor and kernel-based regressors.

Схожие новости

#	Наименование новости	Тональность	Информативность	Дата публикации
1	Statistical Learning Theory for Neural Operators	0	10.21	17-08-2026
2	A Fully Parameter-Free Second-Order Algorithm for Convex-Concave Minimax Problems	0	13.11	17-08-2026
3	A Single-Loop Stochastic Proximal Quasi-Newton Method for Large-Scale Nonsmooth Convex Optimization	0	8	17-08-2026
4	Persistence Diagrams Estimation of Multivariate Piecewise H{\"o}lder-continuous Signals	0	6.3	17-08-2026
5	Deconvolution in unlinked linear models	0	4.62	17-08-2026
6	Error Analysis for Deep ReLU Feedforward Density-Ratio Estimation with Bregman Divergence	0	8.78	17-08-2026
7	The Distribution of Ridgeless Least Squares Interpolators	0	5.78	17-08-2026
8	Nonlinear function-on-function regression by RKHS	0	6.1	17-08-2026
9	A Data-Augmented Contrastive Learning Approach to Nonparametric Density Estimation	0	8.4	17-08-2026
10	Stochastic Gradient Methods: Bias, Stability and Generalization	0	6.3	17-08-2026

Классификация: Пресс-релизы. Схожих патентов: 0. Схожих новостей: 10. Тональность: 0. Информативность: 9.71. Источник: jmlr.org.