My name is Jiahui Pan. I received my B.S. degree in computer science and M.S. degree in computer application technology from South China Normal University in Guangzhou, China, in 2008. My early research was on medical image processing and virtual surgery simulation, when I worked with Prof. Susu Bao. I worked as a technical adviser at Shenzhen Yorktal Digital Medical Imaging Technology Company Ltd. during 2009 and 2010. After 2010, I studied for my PhD degree in pattern recognition and intelligent systems under Prof. Yuanqing Li at South China University of Technology in Guangzhou, China. There, I started my research on brain signal processing, pattern recognition, and their applications in brain-computer interfaces.

In 2008, I joined the School of Software, South China Normal University, China, where I am now a full Professor. I am now focusing on brain-computer interfaces, including pattern recognition, brain signal processing, hybrid brain-computer interfaces, and their applications. I successfully administered multiple university- and NSF-funded projects, and published 10 patents from my projects. I have participated in 20 national, provincial and ministerial projects, including the National Key R&D Program, the 2030 Major Project of Scientific and Technological Innovation, the National 863 Program, the Key Project of the National Natural Science Foundation, the Special Project on Key Areas of Artificial Intelligence for Universities in Guangdong Province, and the Major Special Project of Guangzhou Industry-University-Research Collaborative Innovation. As a PI or co-Investigator, I laid the groundwork for the proposed research by developing several effective brain-computer interface systems for wheelchair control, emotion recognition, and awareness detection, and provided clinical beside tools for patients with low-level cognition and low control abilities by establishing strong ties with hospital. 

Until now, I am the author or co-author of over 160 peer reviewed papers in international journals and conferences, such as BRAIN, P IEEE, IEEE T NEUR SYS REH, IEEE T BIO-MED ENG, IEEE T AFFECT COMPUT, and J NEURAL ENG. Since 2018, three of my papers have been selected as ESI highly cited papers. I am the winner of the first prize for Character Input Item (2/4) and, the second prize for Switch Control Item (1/3) in the 2011 National Brain Computer Interface Competition, the second prize for Video Display Item (2/5) in the 2015 National Brain Computer Interface Competition, the first prize for the 2017 BCI Brain Control Robot Competition (4/7), the first prize for the 2020 Excellent Youth Paper (1/1) in World Robotics Competition, and the Outstanding Paper Award of CCF China Computer Application Conference 2022 (1/1). Moreover, our team won the 2011 Guangdong Science and Technology Award (Technology Progress, 8/14), the 2011 Chinese Medical Science and Technology Award (4/11), and the 2017 Guangdong Science and Technology Award (Natural Science, 5/8). I was also awarded the title of Guangzhou Pearl River S&T Nova Scholar in 2017, the South China Normal University "My Favorite Teacher" in 2014 and 2016 respectively, the South China Normal University Excellent Teacher in 2017, the South China Normal University Famous Teacher in 2019, and "My Favorite Tutor" at South China Normal University in 2021.

[1]  Jiahui Pan, Qiuyou Xie, Pengmin Qin, Fei Wang, Haiyun Huang, Yanbin He, Ronghao Yu, Yuanqing Li*. Prognosis for Patients with Cognitive Motor Dissociation Identified by Brain-Computer Interface. Brain, 2020, 143(4): 1177-1189. DOI: 10.1093/brain/awaa026. (SCI, JCR Q1 Top, IF: 14.5, Google cited: 94)

[2]  Haiyun Huang, Jiahui Pan, Yanbin He, Zhenfu Wen, Ronghao Yu, Yuanqing Li. An EEG-Based Brain Computer Interface for Emotion Recognition and Its Application in Patients with Disorder of Consciousness. IEEE Transactions on Affective Computing, 2021, 12(4): 832-842. DOI: 10.1109/TAFFC.2019.2901456. (SCI, JCR Q1 Top, IF: 11.6, Google cited: 103)

[3] Jiahui Pan*, Honghua Cai, Haiyun Huang, Yanbin He, Yuanqing Li. Multiple Scale Convolutional Few Shot Learning Networks for Online P300-based Brain-Computer Interface and Its Application to Patients with Disorder of Consciousness. IEEE Transactions on Instrumentation and Measurement, 2023, 72: 1-16. DOI: 10.1109/TIM.2023.3267367. (SCI, JCR Q1, IF: 5.6)

[4]  Jiahui Pan*, Lei Wang, Haiyun Huang, Jun Xiao, Fei Wang, Qimei Liang, Chengwei Xu, Yuanqing Li*, Qiuyou Xie*. A Hybrid Brain–Computer Interface Combining P300 Potentials and Emotion Patterns for Detecting Awareness in Patients with Disorders of Consciousness. IEEE Transactions on Cognitive and Developmental Systems, 2022, early access. DOI: 10.1109/TCDS. 2022.3213194. (SCI, CAA A, IF: 5.0)

[5] Jiahui Pan*, Xugang Cai, Danying Mo, Yangzuyi Yu, Yuanqing Li. Residual Attention Capsule Network for Multimodal EEG- and EOG-based Driver Vigilance Estimation. IEEE Transactions on Instrumentation and Measurement, 2023, accepted. DOI: 10.1109/TIM.2023.3307756. (SCI, JCR Q1, IF: 5.6)

[6]  Yuanqing Li#, Jiahui Pan#, Jinyi Long, Tianyou Yu, Fei Wang, Zhuliang Yu, Wei Wu. Multimodal BCIs: Target Detection, Multidimensional Control, and Awareness Evaluation in Patients with Disorder of Consciousness. Proceedings of the IEEE, 2016, 104(2): 332–352. DOI: 10.1109/JPROC.2015.2469106. (SCI, JCR Q1 Top, IF: 20.6, Google cited: 112)

[7] Jiahui Pan, Yuanqing Li, Rui Zhang, Zhenghui Gu, Feng Li. Discrimination Between Control and Idle States in Asynchronous SSVEP-Based Brain Switches: A Pseudo-Key-Based Approach. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2013, 21(3): 435-443. DOI: 10.1109/TNSRE.2013.2253801. (SCI, JCR Q1, IF: 4.6, Google cited: 88)

[8]  Yuanqing Li#, Jiahui Pan#, Fei Wang, Zhuliang Yu. A Hybrid BCI System Combining P300 and SSVEP and Its Application to Wheelchair Control. IEEE Transactions on Biomedical Engineering, 2013, 60(11): 3156-3166. DOI: 10.1109/TBME.2013. 2270283. (SCI, JCR Q1, IF: 4.9, Google cited: 368)

[9]  Jinyi Long, Yuanqing Li*, H. Wang, T. Yu, Jiahui Pan. A Hybrid Brain Computer Interface to Control the Direction and Speed of a Simulated or Real Wheelchair. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2012, 20(5): 720-729. DOI: 10.1109/TNSRE. 2012.2197221. (SCI, JCR Q1, IF: 4.6, Google cited: 323)

[10]  Jun Xiao, Yanbin He, Tianyou Yu, Jiahui Pan, Qiuyou Xie, Zhenghui Gu, Zhuliang Yu, Yuanqing Li*. Towards Assessment of Sound Localization in Disorders of Consciousness Using a Hybrid Audiovisual Brain-Computer Interface. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2022, 30:1422-1432. DOI: 10.1109/TNSRE.2022.3176354. (SCI, JCR Q1, IF: 4.6)

[11]  Jiahui Pan, Qiuyou Xie, Yanbin He, Fei Wang, Haibo Di, Steven Laureys, Ronghao Yu, Yuanqing Li. Detecting Awareness in Patients with Disorders of Consciousness Using a Hybrid Brain-Computer Interface. Journal of Neural Engineering, 2014, 11(5): 056007. DOI: 10.1088/ 1741-2560/11/5/056007. (SCI, JCR Q1, IF: 4.0, Google cited: 97)

[12] Jianyong Huang, Lina Qiu, Jun Xiao, Haiyun Huang, Xiangyu Shi, Fei Wang, Yanbin He, Jiahui Pan*. Hybrid Asynchronous Brain-Computer Interface for Yes/No Communication in Patients with Disorders of Consciousness. Journal of Neural Engineering, 2021, 18(5): 056001. DOI: 10.1088/1741-2552/abf00c (SCI, JCR Q1, IF: 4.0)

[13] Zhipeng He, Jiahui Pan*. An Adversarial Discriminative Temporal Convolutional Network for EEG-based Cross-domain Emotion Recognition. Computers in Biology and Medicine, 2022, 141: 105048. DOI: 10.1016/j.compbiomed.2021.105048. (SCI, JCR Q1, IF: 7.7)

[14] Yaoguang Ye, Yan Liang, Jiahui Pan*. A Cascaded Spatiotemporal Attention Network for Dynamic Facial Expression Recognition. Applied Intelligence, 2023, 53: 5402–5415. DOI: 10.1007/s10489-022-03781-0. (SCI, JCR Q2, IF: 5.3)

[15] Zengwei Yao, Zihao Wang, Weihuang Liu, Yaqian Liu, Jiahui Pan*. Speech Emotion Recognition Using Fusion of Three Multi-task Learning-based Classifiers: HSF-DNN, MS-CNN and LLD-RNN. Speech Communication, 2020, 120: 11-19. DOI: 10.1016/j.specom.2020.03.005. (SCI, CCF B, Google cited: 103)

[16] Honghua Cai, Jiarui Jin, Haoyu Wang, Liujiang Li, Yucui Huang, Jiahui Pan*. AITST–Affective EEG-based Person Identification via Interrelated Temporal-Spatial Transformer. Pattern Recognition Letters , 2023, accepted. (SCI, JCR Q2, IF: 5.1)

[17] Honghua Cai, Jiahui Pan*. Two-Phase Prototypical Contrastive Domain Generalization for Cross-Subject EEG-Based Emotion Recognition. 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023.06, Rodos Island, Greek. (CCF B)

[18] Zhipeng He, Yongshi Zhong, Jiahui Pan*. Joint Temporal Convolutional Networks and Adversarial Discriminative Domain Adaptation for EEG-based Cross-Subject Emotion Recognition. 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022.05, Singapore. (CCF B)

[19] 潘家辉*, 何志鹏, 李自娜, 梁艳, 邱丽娜. 多模态情绪识别研究综述. 智能系统学报, 2020, 15(04): 633-645. (CCF T2, 《智能系统学报》年度优秀论文奖)

[20] 叶耀光, 陈宗楠, 陈丽群, 潘永琪, 潘家辉*. 基于通道注意的可变形金字塔表情识别网络.  计算机技术与发展, 2022,32(11). (CCF计算机应用大会优秀论文奖)

More papers and details could be found in https://www.researchgate.net/profile/Jiahui_Pan/research

Positions and Employment

2008-2013   Lecturer, Department of Information Engineering, South China Normal University, CN

2013-2016   Director, Department of Software Engineering, School of Software, South China Normal University, CN

2016-2018   Associate Professor, Assistant Dean, School of Software, South China Normal University, CN

2018-2020  Associate Professor, Vice Dean, School of Software, South China Normal University, CN

2020-         Professor, Vice Dean, School of Software, South China Normal University, CN

Other Experience and Professional Memberships

2012-2014   Member, Chinese Society of Biomedical Engineering

2015-2017   Member, Asia-Pacific Neural Network Society

2016-2017   Visiting Scholar, Center for Brain Computer Interface and Brain Information Processing, SCUT

2016-            Reviewer: IEEE TNNLS、IEEE TAFFC、IEEE THMS、IEEE TDCS、IEEE TNSRE、J NEURAL ENG……

2018.03        IJCAI and ECAI Reviewer: 27th International Joint and 23rd European Conference on Artificial Intelligence

2018-            Associate Editor, Frontiers in Human Neuroscience (Brain-Computer Interface Section)

2018-            Standing Committee Member, Digital Medicine Branch of Guangdong Medical Association

2019-            Member,  IEEE

2020-            Member, Brain Computer Interface Society

2021-            Associate Editor, AI and Autonomous Systems

Honors

2011             ThirdbPrize, Chinese Medical Science and Technology Award, Beijing, CN

2011             First Prize, Character Input Item, National Brain Computer Interface Competition, Beijing, CN

2011            Second Prize, Switch Control Item, National Brain Computer Interface Competition, Beijing, CN

2011             First Prize, Guangdong Science and Technology Progress Award, Guangzhou, CN

2015             Second Prize, Video Display Item, National Brain Computer Interface Competition, Beijing, CN

2017             First Prize Award, BCI Brain Control Robot Competition, World Robotics Conference, Beijing, CN

2017             Guangzhou Pearl River Science and Technology Nova Award, Guangzhou, CN

2017             First Prize, Guangdong Science and Technology Progress Award, Guangzhou, CN

2018             South China Normal University Excellent Teacher Award, Guangzhou, CN

2019             South China Normal University Famous Teacher Award, Guangzhou, CN

2020            Foshan Higher Education High-Level Talents Award, Foshan, CN

2020            First Prize Award, Excellent Youth Paper, World Robotics Competition, Foshan, CN

2022            Huawei ICT Competition 2021-2022 Global Final, Third Prize

2022            Outstanding Paper of the Year Award, Journal of Intelligent Systems, CN

2022            CCF NCAA Committee Outstanding Paper Award, CN

2023            ScienceFather Best Researcher Award

Ongoing Research Support

National Natural Science Foundation of China   Jiahui Pan (PI)    01/20-12/24

Brain-computer interface awareness detection technology for patients with consciousness disorders and its clinical application

The goal of this study is to solve the problem of a serious lack of behavioral response and a high rate of clinical misdiagnosis in patients with consciousness disorders, and this program aims to conduct research on studies based on consciousness detection technology of brain computer interfaces as well as its clinical application.

Role: PI

Special Innovation Project of Guangdong Universities    Jiahui Pan (PI)    07/01/22-06/30/24

Key technology research and clinical application of multimodal emotional brain-computer interface for patients with disorders of consciousness

The goal of this study is to combine EEG spatio-temporal information and adversarial discriminative domain adaptation algorithm to improve the performance of cross-subject emotion recognition in the patients with DOC.

Role: PI

Guangdong Natural Science Foundation     Jiahui Pan (PI)         10/01/19-09/31/23

Hybrid brain-computer interface based emotion recognition and its application in patients with disorders of consciousness

The goal of this study is to develop an emotion recognition framework based on LSTM for the hybrid brain-computer interface, and explore the emotion-related cognitive functions in patients with disorders of consciousness.

Role: PI

Key Realm R & D Program of Guangzhou     Pengmin Qin (PI)        04/01/20-03/31/23

Brain-computer interface technology for patients with disorders of consciousness and its clinical application

The goal of this study is to explore the application of BCIs in assisting CRS-R assessments of patients with disorders of consciousness, and develop an automatic sleep staging BCI system for awareness detection and rehabilitation training in these challenging patients.

Role: Co-Investigator

Cultivation of Guangdong College S & T Innovation        Jiahui Pan (PI)             01/01/20-12/31/22

Mindlink-Explorer: open platform of multimodal toolbox for real-time detection of emotion and attention

The goal of this project is to create an open source toolbox based on EEG and facial Expression to provide the real-time measurement of emotion and attention.

Role: PI

Completed Research Support

 National Natural Science Foundation     Jiahui Pan (PI)             01/01/19-12/31/19

Hybrid brain-computer interface and its application in patients with disorders of consciousness

The goal of this study was to develop a visual hybrid BCI combining P300 and SSVEP responses and an audiovisual BCI to detect awareness in 78 severely brain injured patients.

Role: PI

Pearl River S&T Nova Program of Guangzhou     Jiahui Pan (PI)             05/01/17-04/30/20

Asynchronous brain computer interface based on multimodal EEG and its application

The goal of this project was to develop a double-layer fusion scheme and algorithm for the multimodal EEG signals, which realized the comprehensive utilization of the redundant and complementary EEG information, and propose a hybrid P300, SSVEP and attention based idle detection to improve the performance of the asynchronous control.

Role: PI

National Natural Science Foundation     Jiahui Pan (PI)             01/01/16-12/30/18

Hybrid asynchronous brain computer interface based on P300 and SSVEP

This project aimed to combine the P300, SSVEP and N200 into a hybrid BCI paradigm to improve the performance of the asynchronous control.

Two hybrid asynchronous BCI systems were developed, including the hybrid P300, SSVEP and N200-based communication system for the disabled, and the hybrid P300, SSVEP and attention-based brain switch for wheelchair control.

Role: PI

Guangdong Natural Science Foundation     Jiahui Pan (PI)             01/01/15-12/30/17

Research on key technologies of multimodal asynchronous brain computer interface

The goal of this project was to provide the multiple independent control signals for the multi-degree continuous control of a brain-controlled wheelchair.

Role: PI

Research and Cultivation Fund for Young Teachers     Jiahui Pan (PI)             01/01/14-12/30/15

EEG signal analysis algorithm for brain computer interface

The goal of this project was to propose some modified EEG feature extraction algorithm (e.g., Minimum Energy Combination, Bayesian Feature
Selection, and Filter Bank P-CSP) for high performance brain computer interfaces.

Role: PI