Face-expression and speech recognition based rehabilitation training system

Abstract

© 2019, Executive Office of the Journal. All right reserved. A cerebral palsy rehabilitation training system is designed based on human-computer interaction (HCI). Using the combination of upper computer and lower computer, the lower computer adopts 51 single-chip microcomputer for main drive, the voice acquisition module uses LD3320 voice chip, and connects the lower computer of C language programming with the upper computer written by Labview through serial communication. The voice chip sends the signal identification result to the host computer through the serial port, and the host computer performs identification matching according to the voice semantic rule, judges and counts the test, and matches the result with the expression robot. By recording the number of times the two patients correctly recognized the expression and the recognition time, the data are analyzed, and the results prove that the system can improve the effect of cerebral palsy rehabilitation training.