We consider the problem of density-ratio estimation using Bregman Divergence with Deep ReLU feedforward neural networks (BDD). We establish non-asymptotic error bounds for BDD density-ratio estimators, which are minimax optimal up to a logarithmic factor when the data distribution has finite support. As an application of our theoretical findings, we propose an estimator for the KL-divergence that is asymptotically normal, leveraging our convergence results for the deep density-ratio estimator and a data-splitting method. We also extend our results to cases with unbounded support and unbounded density ratios. Furthermore, we show that the BDD density-ratio estimator can mitigate the curse of dimensionality when data distributions are supported on an approximately low-dimensional manifold. Our results are applied to investigate the convergence properties of the telescoping density-ratio estimator proposed by Rhodes (2020). We provide sufficient conditions under which it achieves a lower error bound than a single-ratio estimator. Moreover, we conduct simulation studies to validate our main theoretical results and assess the performance of the BDD density-ratio estimator.
| # | Наименование новости | Тональность | Информативность | Дата публикации |
|---|---|---|---|---|
| 1 | A Data-Augmented Contrastive Learning Approach to Nonparametric Density Estimation | 0 | 8.4 | 17-08-2026 |
| 2 | Nonparametric Estimation of a Factorizable Density using Diffusion Models | 0 | 8.59 | 17-08-2026 |
| 3 | Near-optimal Delta-convex Estimation of Lipschitz Functions | 0 | 9.71 | 17-08-2026 |
| 4 | Statistical Learning Theory for Neural Operators | 0 | 10.21 | 17-08-2026 |
| 5 | A Mean-Field Analysis of Neural Stochastic Gradient Descent-Ascent for Functional Minimax Optimization | 0 | 9.82 | 17-08-2026 |
| 6 | Kernel-based Distributed Learning | 0 | 7 | 17-08-2026 |
| 7 | High-Dimensional Analysis of Gradient Flow for Extensive-Width Quadratic Neural Networks | 0 | 8.7 | 17-08-2026 |
| 8 | End-to-End Deep Learning for Predicting Metric Space-Valued Outputs | 0 | 10.66 | 17-08-2026 |
| 9 | Extending Mean-Field Variational Inference via Entropic Regularization: Theory and Computation | 0 | 8.7 | 17-08-2026 |
| 10 | Minimax density estimation in the adversarial framework under local differential privacy | 0 | 3.48 | 17-08-2026 |