IEEE Transactions on Multimedia 2023

High-Quality Reconstruction of Depth Maps From Graph-Based
Non-Uniform Sampling

 

Jingyu Yang1, Wenqiang Xu1, Yusen Hou1, Xinchen Ye2, Pascal Frossard3, Kun Li1*

1 Tianjin University   2 Dalian University of Technology   3 Ecole Polytechnique F´ed´erale de Lausanne  

  * Corresponding author

 

[Paper] [Paper@IEEE]

 

Abstract

Depth sensing is essential for intelligent computer vision applications, but it often suffers from low range precision and spatial resolution. To address this problem, we propose a novel framework that combines non-uniform sampling and reconstruction based on graph theory. Our framework consists of two main components: (1) a graph Laplacian induced non-uniform sampling (GLINUS) scheme that samples depth signals more densely around edges and contours than in smooth regions, and (2) an ensemble of priors (EoP) model that reconstructs the highquality depth map using adaptive dual-tree discrete wavelet packets (ADDWP) transform, graph total variation regularizer, and graph Laplacian regularizer with color guidance. We solve the reconstruction problem using the alternating direction method of multipliers (ADMM). Our experiments demonstrate that our framework can capture fine structures and global information in depth signals and produce superior depth reconstruction results.


Results

 

 

Fig 3. Visual results of depth reconstruction for “Dolls” (top) and “Laundry”(bottom) with different sampling schemes at a ratio of 2.78%: (a) GT RGB-D pair, (b) uniform sampling, (c) random sampling, (d) IPCA [5], (e) our GLINUS0.0, and (f) our GLINUS0.2. For better visualization, we show two cropped patches and the associated error maps.

 

 

Fig 4. Visual comparison results under different sampling schemes at the sampling ratio of 1.56% for image “Art”(top), “Reindeer”(middle) and “Aloe”(bottom). The results are generated by (a) GT, (b) FGI [27], (c) RCG [28], (d) Bicubic, (e) PFitDR [53], (f) Wavelet [5], and (g) our EoP model. For better visualization, for each image, we show two cropped patches as well as the associated error map in absolute difference.

 


Technical Paper

 


Citation

Jingyu Yang, Wenqiang Xu, Yusen Hou, Xinchen Ye, Pascal Frossard, and Kun Li*, High-Quality Reconstruction of Depth Maps From Graph-Based Non-Uniform Sampling, IEEE Transactions on Multimedia, 2023.

 

@ARTICLE{10239508,
  author={Yang, Jingyu and Xu, Wenqiang and Hou, Yusen and Ye, Xinchen and Frossard, Pascal and Li, Kun},
  title={High-Quality Reconstruction of Depth Maps From Graph-Based Non-Uniform Sampling},
  journal={IEEE Transactions on Multimedia},
  year={2023},
}