About Me

Zhilei Liu (刘志磊)

Ph.D, Associate Professor

College of Intelligence and Computing, Tianjin University

92 Weijin Road, NanKai District, TianJin, P. R. China, 300072

Email: zhileiliu@tju.edu.cn

Google Scholar Profile

I am currently an Associate Professor at the College of Intelligence and Computing, Tianjin University, China. I received my Ph.D. degree in Computer Science from the University of Science and Technology of China (USTC) in Jun. 2014. From 2012 to 2013, I was a joint Ph.D. student at the Intelligent Systems Lab, Rensselaer Polytechnic Institute, USA. From 2017 to 2018, I was a Research Fellow at the Multimedia and Interactive Computing Lab, Nanyang Technological University, Singapore.

News&Updates

Update Several positions are available for highly motivated students who are interested in pursuing Master or Ph.D degrees in the areas of Machine Learning and Pattern Recognition. Please feel free to contact me if you are interested.

Research Interests

Multimedia Computing Pattern Recognition Computer Vision Affective Computing

Publications

Journal Papers

  1. Zhiwen Shao, Zhilei Liu (Co-first author), Jianfei Cai, Lizhuang Ma: JÂA-Net: Joint Facial Action Unit Detection and Face Alignment Via Adaptive Attention. International Journal of Computer Vision, 129, 321–340, 2021. New
  2. Zhiwen Shao, Zhilei Liu*, Jianfei Cai, Yunsheng Wu, Lizhuang Ma: Facial Action Unit Detection Using Attention and Relation Learning. IEEE Transactions on Affective Computing. Oct. 2019.
  3. Zhilei Liu*, Guoxian Song, Jianfei Cai, Tat-Jen Cham, Juyong Zhang: Conditional adversarial synthesis of 3D facial action units. NeuroComputing, 355, 200-208, 2019.
  4. Lili Guo, Longbiao Wang, Jianwu Dang, Zhilei Liu, Haotian Guan: Exploration of Complementary Features for Speech Emotion Recognition Based on Kernel Extreme Learning Machine. IEEE Access 7: 75798-75809, 2019.
  5. Cuicui Zhang, Hao Wei, Chongke Bi, Zhilei Liu*: Helmholtz–Hodge decomposition-based 2D and 3D ocean surface current visualization for mesoscale eddy detection. Journal of Visualization, 22 (2), 231–243, 2019.
  6. Cuicui Zhang, Zhilei Liu*, Chongke Bi, Shuai Chang: Dependent Motion Segmentation in Moving Camera Videos: A Survey. IEEE Access 6: 55963 - 55975. October 2018.
  7. Yan Ji, Licheng Liu, Hongcui Wang, Zhilei Liu, Zhibin Niu, Bruce Denby: Updating the Silent Speech Challenge benchmark with deep learning. Speech Communication 98: 42-50 (2018)
  8. Cuicui Zhang, Zhilei Liu*: Prior-Free Dependent Motion Segmentation Using Helmholtz-Hodge Decomposition Based Object-Motion Oriented Map. Journal of Computer Science and Technology, Volume 32, Issue 3, pp 520–535, May 2017.
  9. Shangfei Wang, Zhilei Liu, etc.: Implicit video emotion tagging from audiences' facial expression. Multimedia Tools and Applications, Volume 74, Issue 13, pp. 4679-4706, July 2015, ISSN 1573-7721.
  10. Shangfei Wang, Zhilei Liu, etc.: Exploiting Multi-expression Dependences for Implicit Multi-Emotion Video Tagging. Image and Vision Computing, Volume 32, Issue 10, October 2014, Pages 682-691, ISSN 0262-8856.
  11. Shangfei Wang, Zhilei Liu, etc.: Eye localization from thermal infrared images. Pattern Recognition, Elsevier, Volume 46, Issue 10, Pages 2613-2621, October 2013.
  12. Shangfei Wang, Zhilei Liu, etc.: Analyses of a Multi-modal Spontaneous Facial Expression Database. IEEE Transactions on Affective Computing, Vol.4, No.1, pp.34-46. Jan.-June 2013.
  13. Shangfei Wang, Zhilei Liu, etc.: A Natural Visible and Infrared Facial Expression Database for Expression Recognition and Emotion Inference. IEEE Transaction on Multimedia, Vol.12, No.7, pp.682-69. November 2010.

Conference Papers

  1. Ruixin Xiao, Zhilei Liu*, Baoyuan Wu: Teacher-Student Competition for Unsupervised Domain Adaptation. International Conference on Pattern Recognition (ICPR 2020), Virtual Event, January 10–15, 2021, Milan, Italy.New
  2. Jiaxing Liu, Sen Chen, Longbiao Wang, Zhilei Liu*, Yahui Fu, Lili Guo, Jianwu Dang: Multimodal Emotion Recognition with Capsule Graph Convolutional Based Representation Fusion. 46th International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2021), 6-11 June 2021, Toronto, Ontario, Canada.New
  3. Yahui Fu, Lili Guo, Longbiao Wang, Zhilei Liu, Jiaxing Liu, Jianwu Dang: A Sentiment Similarity-Oriented Attention Model with Multi-task Learning for Text-Based Emotion Recognition. 27th International Conference on Multimedia Modeling (MMM 2021), 278-289, June 22–24, 2021, Prague, Czech Republic.New
  4. Jiaxing Liu, Zhilei Liu*, Longbiao Wang, Yuan Guo, Lili Guo, Jianwu Dang: Temporal Attention Convolutional Network for Speech Emotion Recognition with Latent Representation. INTERSPEECH 2020, October 25-29, 2020, Shanghai, China.
  5. Jiaxing Liu, Zhilei Liu*, Longbiao Wang, Lili Guo, Jianwu Dang: Speech Emotion Recognition with Local-Global Aware Deep Representation Learning. 45th International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2020), May 4-8, 2020, Barcelona, Spain.
  6. Zhilei Liu, Diyi Liu, Yunpeng Wu: Region Based Adversarial Synthesis of Facial Action Units. 26th International Conference on Multimedia Modeling (MMM 2020), January 5-8, 2020, Daejeon, Korea.
  7. Zhilei Liu, Le Li, Yunpeng Wu, Cuicui Zhang: Facial Expression Restoration Based on Improved Graph Convolutional Networks. 26th International Conference on Multimedia Modeling (MMM 2020), January 5-8, 2020, Daejeon, Korea.
  8. Zhilei Liu, Jiahui Dong, Cuicui Zhang, Longbiao Wang, Jianwu Dang: Relation Modeling with Graph Convolutional Networks for Facial Action Unit Detection. 26th International Conference on Multimedia Modeling (MMM 2020), January 5-8, 2020, Daejeon, Korea.
  9. Lili Guo, Longbiao Wang, Jianwu Dang, Zhilei Liu and Haotian Guan: Speaker-Aware Speech Emotion Recognition by Fusing Amplitude and Phase Information. 26th International Conference on Multimedia Modeling (MMM 2020), January 5-8, 2020, Daejeon, Korea.
  10. Jiaxing Liu, Zhilei Liu*, Longbiao Wang, Jianwu Dang: Time-Frequency Deep Representation Learning for Speech Emotion Recognition Integrating Self-Attention. 26th International Conference on Neural Information Processing (ICONIP2019), Dec. 12-15, 2019, Sydney, Australia.
  11. Le Li, Zhilei Liu*, Cuicui Zhang: Face Inpainting with Dynamic Structural Information of Facial Action Units. The 10th International Conference on Image and Graphics (ICIG 2019), Aug. 23-25, Beijing China.
  12. Zhiwen Shao, Zhilei Liu*, Jianfei Cai, Lizhuang Ma: Deep Adaptive Attention for Joint Facial Action Unit Detection and Face Alignment, ECCV 2018, September 7-14, 2018, Munich, Germany.
  13. Zhilei Liu, Cuicui Zhang: Spatio-temporal Analysis for Infrared Facial Expression Recognition from Videos, ICVIP 2017, December 27-29, 2017, Singapore.
  14. Haotian Guan, Zhilei Liu, Jianwu Dang: Speech Emotion Recognition Considering Local Dynamic Features, ISSP 2017, October 16-19, 2017, Tianjin, China.
  15. Bogu Li, Zhilei Liu, Jianwu Dang: Study on the Relation of Fundamental and Formant Frequencies for Affective Speech Synthesis, ISCSLP 2016, October 17-20, 2016, Tianjin, China.
  16. Hui Feng, Wenfu Bao, Jianwu Dang, Zhilei Liu: Perception of Mandarin Tones by Native Tibetan, INTERSPEECH 2015, pp. 811-814, September 6-10, 2015, Dresden, Germany
  17. Guancheng Li, Jianwu Dang, Gaoyan Zhang, Zhilei Liu: Investigation of relation between speech perception and production based on EEG source reconstruction, Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2015), Dec. 16-19, 2015.
  18. Baoyuan Wu, Zhilei Liu, Shangfei Wang, Baogang Hu, Qiang Ji: Multi-label Learning with Missing Labels. 2014 22nd International Conference on Pattern Recognition (ICPR), vol., no., pp.1964,1968, 24-28 Aug. 2014.
  19. Menghua He, Shangfei Wang, Zhilei Liu: Analyses of the Differences between Posed and Spontaneous Facial Expressions. 5th International Conference on Affective Computing and Intelligent Interaction, ACII 2013. September 2-5, 2013, Geneva, Switzerland.
  20. Zhilei Liu, Shangfei Wang, Zhaoyu Wang, and Qiang Ji: Implicit Video Multi-Emotion Tagging by Exploiting Multi-Expression Relations. 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2013, April 22, 2013 - April 26, 2013, Shanghai, China.
  21. Zhaoyu Wang, Shangfei Wang, Menghua He, Zhilei Liu, Qiang Ji: Emotional tagging of videos by exploring multi-emotion coexistence. 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2013, April 22, 2013 - April 26, 2013, Shanghai, China.
  22. Zhilei Liu, Shangfei Wang: Posed and Spontaneous Expression Distinguishment from Infrared Thermal Images. The 21st International Conference on Pattern Recognition (ICPR 2012), Tsukuba, Japan. 2012.
  23. Shangfei Wang, Peijia Shen, Zhilei Liu: Eye Localization from Infrared Thermal Images. Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction (MPRSS 2012), LNCS, Vol 7742, 2013, pp. 35-42. Tsukuba, Japan. 2012.
  24. Shangfei Wang, Peijia Shen, Zhilei Liu: Facial Expression Recognition from Infrared Thermal Images using Temperature Difference by Voting. The 2nd IEEE International Conference on Cloud Computing and Intelligence Systems (IEEE CCIS2012), vol.01, no., pp.94,98, Oct. 30 2012-Nov. 1 2012, Hangzhou, China. 2012.
  25. Peijia Shen, Shangfei Wang, Zhilei Liu: Facial Expression Recognition from Infrared Thermal Videos. The 12th International Conference on Intelligent Autonomous Systems (IAS-12), Advances in Intelligent Systems and Computing, Volume 194, 2013, pp 323-333 Jeju Island, Korea, 2012.
  26. Zhilei Liu, Shangfei Wang: Emotion Recognition Using Hidden Markov Models from Facial Temperature Sequence. International Conference on Affective Computing and Intelligent Interaction, ACII 2011, Part II, LNCS 6975, pp.240-247, 2011
  27. Shangfei Wang, Zhilei Liu: Infrared Face Recognition Based on Histogram and K-Nearest Neighbor Classification. 7th International Symposium on Neural Networks, ISNN (2) 2010: 104-111, Shanghai, China

Technical Reports

  1. Shangfei Wang, Zhilei Liu, Xiaoping Chen, Xufa Wang: Affective Human-Robot Interaction Research in USTC (Extended Abstract), NSF/WTEC Workshop on Human-Robot Interaction, Oct. 2011, Beijing, China. [Presentation]

Dissertation

  • [Ph. D, University of Science and Technology of China] The Applied Research of Probabilistic Graphic Model on Affective Computing (May 2014, in Chinese)

    • Academic Activities

  • Member of IEEE, ACM, CCF, CSIG
  • Invited Reviewer, IEEE Transactions on Affective Computing
  • Invited Reviewer, IEEE Transactions on Multimedia
  • Guest Reviewer, Image and Vision Computing Journal
  • Invited Reviewer, Multimedia Systems

    • Teaching

  • Graduate courses
    		•  Frontier of Cognitive Computing and Intelligent Information Processing
  • Undergraduate courses
    		•  Introduction to Computing Principles [2019 Fall, 2019 Fall, 2018 Fall, 2016 Fall]
    Data Structure [2021 Spring, 2020 Spring, 2019 Fall, 2019 Spring]
    Mathematical Foundation of Artificial Intelligence [2021 Spring]
    Introduction to Affective Computing [2020 Fall]
    Visual C++ Programming [2019 Spring]
    Computer Network [2016 Fall]

    Resources

    Resource collection for related research groups, tutorials, courses, toolboxes, datasets and so on.