Optics Express 2025 Editors' Pick

Non-line-of-sight multi-person pose sensing

 

Yusen Hou1#, Xingyu Cui1#, Shida Sun2, Yue Li,2, Jing Huang1, Zhi Lu3, Kun Li,1, Zhiwei Xiong2, Jingyu Yang1*

1 Tianjin University   2 University of Science and Technology of China   3 Tsinghua University  

  # Equal contribution   * Corresponding author

 

[Paper] [DataSet(Coming Soon)]

 

Abstract

In the fields of anti-terrorism and emergency rescue, human pose sensing under non-line-of-sight (NLOS) conditions plays a critical role in enabling informed decision-making and effective response. Current research predominantly focuses on line-of-sight (LOS) scenarios but pays limited attention to NLOS conditions, and even these NLOS studies are confined to single-person pose detection, significantly restricting real-world multi-person applications. In this paper, we propose the first method that enables adaptive multi-person pose sensing in NLOS environments. Our approach reconstructs coarse 3D features from transients and refines these features through a neural network. The refined features are then utilized to predict a 3D body center heatmap and a mesh parameter map. Finally, using 3D body center-guided parameter sampling, the method enables adaptive multi-person 3D mesh regression. Comprehensive experiments on both simulated data and real-world data acquired using our self-built NLOS system demonstrate that our method effectively senses human poses in multi-person NLOS scenarios. Notably, the simulation pipeline we developed for constructing the multi-person NLOS dataset and the real-world data captured by our system provide valuable resources for advancing research in this field. We will publicly release our dataset to support the development of new methods and foster progress in NLOS human pose sensing.


Method

 

 

Fig 1. Method overview.

 

Technical Paper

 


Citation

Yusen Hou, Xingyu Cui, Shida Sun, Yue Li, Jing Huang, Zhi Lu, Kun Li, Zhiwei Xiong and Jingyu Yang. "Non-Line-of-Sight Multi-Person Pose Sensing". Optics Express, 33(20):41937-41950, 2025.

 

@article{hou2025non,
  author = {Hou, Yusen and Cui, Xingyu and Sun, Shida and Li, Yue and Huang, Jing and Lu, Zhi and Li, Kun and Xiong, Zhiwei and Yang, Jingyu},
  title = {Non-Line-of-Sight Multi-Person Pose Sensing},
  journal = {Optics Express},
  volume = {33},
  number = {20},
  pages = {41937--41950},
  year = {2025},
  publisher = {Optica Publishing Group}
}