Automatic stress recognition using gestures and speech modulation
Keywords:
Evaluation, non-contact sensing, sleep monitoring, cost-effective , polysomnography(PSG) ballistocardiogram, photoplethysmographyAbstract
This paper investigates how speech and gestures convey stress, and how they can be used for
automatic stress recognition. Stress can be conveyed by the intended semantic message (e.g. spoken words for
speech, symbolic meaning for gestures), and stress conveyed by the modulation of either speech and gestures (e.g.
intonation for speech, speed and rhythm for gestures). The goal is having a surveillance system that would notify
when the stress level is high and extra assistance is needed. The solution is that speech modulation is the best
performing intermediate level variable for automatic stress prediction. Using gestures increases the performance
and is mostly beneficial when speech is lacking.