ZTE Communications ›› 2021, Vol. 19 ›› Issue (3): 46-55.doi: 10.12142/ZTECOM.202103006

• Special Topic • Previous Articles     Next Articles

Artificial Intelligence Rehabilitation Evaluation and Training System for Degeneration of Joint Disease

LIU Weichen1, SHEN Mengqi2, ZHANG Anda1, CHENG Yiting2, ZHANG Wenqiang1,2()   

  1. 1.Academy for Engineering and Technology, Fudan University, Shanghai 200433, China
    2.School of Computer Science, Fudan University, Shanghai 200433, China
  • Received:2021-06-15 Online:2021-09-25 Published:2021-10-11
  • About author:LIU Weichen is pursuing his master’s degree in the Academy for Engineering & Technology (AET), Fudan University, China. His research interests include machine learning and signal processing.|SHEN Mengqi is a graduate student of the School of Computer Science and Technology, Fudan University, China. His main research interests include action recognition, video understanding and human pose estimation.|ZHANG Anda is pursuing his master’s degree of electronic information in AET, Fudan University, China. His research interests include artificial intelligence and deep learning related to Chinese Medicine.|CHENG Yiting received the M.S. degree in computer science from Fudan University, China in 2021. Her main research interests include unsupervised learning and computer vision.|ZHANG Wenqiang (wqzhang@fudan.edu.cn) is a professor with the School of Computer Science, Fudan University, China. He received his Ph.D. degree in mechanical engineering from Shanghai Jiao Tong University, China in 2004. His current research interests include computer vision and robot intelligence.
  • Supported by:
    National Key R&D Program of China(2019YFC1711800);National Natural Science Foundation of China(62072112);Fudan University-CIOMP Joint Fund(FC2019-005)


Degeneration of joint disease is one of the problems that threaten global public health. Currently, the therapies of the disease are mainly conservative but not very effective. To solve the problem, we need to find effective, convenient and inexpensive therapies. With the rapid development of artificial intelligence, we innovatively propose to combine Traditional Chinese Medicine (TCM) with artificial intelligence to design a rehabilitation assessment system based on TCM Daoyin. Our system consists of four subsystems: the spine movement assessment system, the posture recognition and correction system, the background music recommendation system, and the physiological signal monitoring system. We incorporate several technologies such as keypoint detection, posture estimation, heart rate detection, and deriving respiration from electrocardiogram (ECG) signals. Finally, we integrate the four subsystems into a portable wireless device so that the rehabilitation equipment is well suited for home and community environment. The system can effectively alleviate the problem of an inadequate number of physicians and nurses. At the same time, it can promote our TCM culture as well.

Key words: rehabilitation, Traditional Chinese Medicine, artificial intelligence, degeneration of joint disease