Вход на сайт

Просмотр новости

Найдите то, что Вас интересует

Error Analysis for Deep ReLU Feedforward Density-Ratio Estimation with Bregman Divergence

Дата публикации: 17-08-2026 20:26:00


We consider the problem of density-ratio estimation using Bregman Divergence with Deep ReLU feedforward neural networks (BDD). We establish non-asymptotic error bounds for BDD density-ratio estimators, which are minimax optimal up to a logarithmic factor when the data distribution has finite support. As an application of our theoretical findings, we propose an estimator for the KL-divergence that is asymptotically normal, leveraging our convergence results for the deep density-ratio estimator and a data-splitting method. We also extend our results to cases with unbounded support and unbounded density ratios. Furthermore, we show that the BDD density-ratio estimator can mitigate the curse of dimensionality when data distributions are supported on an approximately low-dimensional manifold. Our results are applied to investigate the convergence properties of the telescoping density-ratio estimator proposed by Rhodes (2020). We provide sufficient conditions under which it achieves a lower error bound than a single-ratio estimator. Moreover, we conduct simulation studies to validate our main theoretical results and assess the performance of the BDD density-ratio estimator.

Схожие новости

#Наименование новостиТональностьИнформативностьДата публикации
1 A Data-Augmented Contrastive Learning Approach to Nonparametric Density Estimation 08.417-08-2026
2 Nonparametric Estimation of a Factorizable Density using Diffusion Models 08.5917-08-2026
3 Near-optimal Delta-convex Estimation of Lipschitz Functions 09.7117-08-2026
4 Statistical Learning Theory for Neural Operators 010.2117-08-2026
5 A Mean-Field Analysis of Neural Stochastic Gradient Descent-Ascent for Functional Minimax Optimization 09.8217-08-2026
6 Kernel-based Distributed Learning 0717-08-2026
7 High-Dimensional Analysis of Gradient Flow for Extensive-Width Quadratic Neural Networks 08.717-08-2026
8 End-to-End Deep Learning for Predicting Metric Space-Valued Outputs 010.6617-08-2026
9 Extending Mean-Field Variational Inference via Entropic Regularization: Theory and Computation 08.717-08-2026
10 Minimax density estimation in the adversarial framework under local differential privacy 03.4817-08-2026

Классификация: Пресс-релизы. Схожих патентов: 0. Схожих новостей: 10. Тональность: 0. Информативность: 8.78. Источник: jmlr.org.