1 Tianjin University 2 Tianjin Yunlan Internet of Things Technology Co., Ltd.
# Equal contribution * Corresponding author
High-rise fire escape training for the public poses a significant challenge, owing to the prohibitive cost and logistical intricacies involved in deploying high-fidelity simulations. While virtual reality (VR) technologies have demonstrated potential in safety education, the number of interaction modalities they offer is mostly limited to 3 to 5 types, and they heavily rely on controllers that abstract actions into button presses, limiting immersion and skill transfer. In this paper, we propose the MIFE system, which designs 8 distinct interaction modalities along with a real-time dynamic fire spread simulation to further improve immersion, allowing trainees to perceive the fire scene and efficiently master key escape skills through vision, auditory, olfactory, etc. Moreover, we have designed a controller-free and real-time full-body motion capture (MoCap) module, achieving precise mapping between the trainees’ full-body movements and the virtual avatar. Additionally, MIFE leverages a knowledge graph to provide tailored guidance, adapting dynamically to trainees with varying levels of fire escape proficiency. The results of the user study demonstrate that MIFE significantly outperforms self-study and controller-based training systems, particularly, improving by 3.08/10 and 2.38/10 in the performance score of the evaluation stage, respectively. This implies its practical utility and potential for broader adoption in high-rise fire emergency training.
Fig 1. Method overview.
Weijie Liu, Yalei Liu, Jiaxuan Gao, Zixuan Xie, Qiuyu Fu, Lu Lu, Jian Ma, Kun Li. "MIFE: A Multimodal VR Immersive Training System for Fire Escape". 2026 IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR), 2026.
@inproceedings{VR2026MIFE,
author = {Liu, Weijie and Liu, Yalei and Gao, Jiaxuan and Xie, Zixuan and Fu, Qiuyu and Lu, Lu and Ma, Jian and Li, Kun},
title = {MIFE: A Multimodal VR Immersive Training System for Fire Escape},
booktitle = {IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR)},
year={2026}
}