1 Tianjin University 2 Dalian University of Technology 3 Ecole Polytechnique F´ed´erale de Lausanne
* Corresponding author
Depth sensing is essential for intelligent computer vision applications, but it often suffers from low range precision and spatial resolution. To address this problem, we propose a novel framework that combines non-uniform sampling and reconstruction based on graph theory. Our framework consists of two main components: (1) a graph Laplacian induced non-uniform sampling (GLINUS) scheme that samples depth signals more densely around edges and contours than in smooth regions, and (2) an ensemble of priors (EoP) model that reconstructs the highquality depth map using adaptive dual-tree discrete wavelet packets (ADDWP) transform, graph total variation regularizer, and graph Laplacian regularizer with color guidance. We solve the reconstruction problem using the alternating direction method of multipliers (ADMM). Our experiments demonstrate that our framework can capture fine structures and global information in depth signals and produce superior depth reconstruction results.
Fig 3. Visual results of depth reconstruction for “Dolls” (top) and “Laundry”(bottom) with different sampling schemes at a ratio of 2.78%: (a) GT RGB-D pair, (b) uniform sampling, (c) random sampling, (d) IPCA [5], (e) our GLINUS0.0, and (f) our GLINUS0.2. For better visualization, we show two cropped patches and the associated error maps.
Fig 4. Visual comparison results under different sampling schemes at the sampling ratio of 1.56% for image “Art”(top), “Reindeer”(middle) and “Aloe”(bottom). The results are generated by (a) GT, (b) FGI [27], (c) RCG [28], (d) Bicubic, (e) PFitDR [53], (f) Wavelet [5], and (g) our EoP model. For better visualization, for each image, we show two cropped patches as well as the associated error map in absolute difference.
Jingyu Yang, Wenqiang Xu, Yusen Hou, Xinchen Ye, Pascal Frossard, and Kun Li*, High-Quality Reconstruction of Depth Maps From Graph-Based Non-Uniform Sampling, IEEE Transactions on Multimedia, 2023.
@ARTICLE{10239508,
author={Yang, Jingyu and Xu, Wenqiang and Hou, Yusen and Ye, Xinchen and Frossard, Pascal and Li, Kun},
title={High-Quality Reconstruction of Depth Maps From Graph-Based Non-Uniform Sampling},
journal={IEEE Transactions on Multimedia},
year={2023},
}