Emotion and Cognitive Reappraisal Based on GSR Wearable Sensor

doi:10.3969/j.issn.1673-5188.2017.S2.003

ZTE Communications ›› 2017, Vol. 15 ›› Issue (S2): 18-22.DOI: 10.3969/j.issn.1673-5188.2017.S2.003

收稿日期:2017-08-19 出版日期:2017-12-25 发布日期:2020-04-16

Emotion and Cognitive Reappraisal Based on GSR Wearable Sensor

LI Minjia¹, XIE Lun¹, WANG Zhiliang¹, REN Fuji^2,³

1. School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China
2. College of Computer Science, Hefei University of Technology, Hefei 230009, China
3. Department of Information Science & Intelligent Systems, University of Tokushima, Tokushima 7708506, Japan

Received:2017-08-19 Online:2017-12-25 Published:2020-04-16
About author:LI Minjia (B20160292@xs.ustb.edu.cn) received her B.E. degree in electronics and information engineering from Xi’an University of Posts & Telecommunications, China, in 2010. She is currently a doctoral candidate in communication and information system at University of Science and Technology Beijing, China. Her research interests are pattern recognition and affective computing.|XIE Lun (xielun@ustb.edu.cn) received his Ph.D. degree from the University of Science and Technology Beijing, China. Now he is a professor at the University of Science and Technology Beijing, and a board member of China Artificial Society. His current research interests include robotics research and affective computing.|WANG Zhiliang (wzl@ustb.edu.cn) received his Ph.D. degree from Harbin Institute of Technology, China. Now, he is a professor at the University of Science and Technology Beijing, and a senior board member of China Artificial Society. His current research interests include artificial psychology and the Internet of Things.|REN Fuji (ren@is.tokushima-u.ac.jp) received his Ph.D. degree from Institute of Computing Technology, Chinese Academy of Sciences, China. Now he is a professor at the Hefei University of Technology, China. He is also the Multi-lingual multimedia multi-function laboratory director, AIA International Institute of highly informative and a consultant of Japanese AGI. His current research interests include intelligent robots and affective computing.
Supported by:
This work was supported in part by the National Key Research & Development Plan of China under Grant No.2016YFB1001404, and in part by the National Natural Science Foundation of China (No. 61432004, 61672093).

摘要/Abstract

Abstract:

Various wearable equipment enables us to measure people behavior by physiological signals. In our research, we present one galvanic skin reaction (GSR) wearable sensor which can analyze human emotions based on cognition reappraisal. First, We research the factors of emotional state transition in Arousal-Valence-Stance(AVS) emotional space. Second, the influence of the cognition on emotional state transition is considered, and the reappraisal factor based on Gross regulation theory is established to correct the effectiveness from cognitive reappraisal ability to emotional state transition. Third, based on the previous work, we establish a GSR emotion sensing system for predicting emotional state transition and considering the correlation between GSR signals and emotions. Finally, an overall wearable sensor layout is built. In the experiment part, we invited 30 college students to wear our GSR sensors and watch 14 kinds of affective videos. We recorded their GSR signals while asking them to record their emotional states synchronously. The experiment results show different reappraisal factors can predict subjects’ emotional state transition well and indirectly confirm the feasibility of the Gross regulation theory.

Key words: wearable equipment, emotional state transition, AVS emotional space, Gross regulation theory, GSR emotion sensing system

. [J]. ZTE Communications, 2017, 15(S2): 18-22.

LI Minjia, XIE Lun, WANG Zhiliang, REN Fuji. Emotion and Cognitive Reappraisal Based on GSR Wearable Sensor[J]. ZTE Communications, 2017, 15(S2): 18-22.

图/表 12

Figure 1. AVS emotional space.

Figure 2. The probability of transition from the positive state to negative state.

Figure 3. Emotion sensing system.

Figure 4. GSR signal curve under calm emotional state.

Figure 5. GSR signal curve under happy emotional state.

Figure 6. GSR signal curve under sad emotional state.

Figure 7. Wearable sensor.

Figure 8. The age distribution of subjects.

Figure 9. Self-assessment manikins.

Table 1 The correlation between the prediction and self-assessment

Valence		Arousal
R-square	Cov	R-square	Cov
0.325	0.667	0.628	0.9673

Figure 9. The distribution of subjects with different reappraisal factors.

Figure 11. The transition curve from self-assessment and emotion sensing system.

参考文献 16

[1]	J. Tomaka, J. Blascovich, R. M. Kelsey , et al., “Subjective, physiological, and behavioral effects of threat and challenge appraisal,” Journal of Personality and Social Psychology, vol. 65, no. 2, pp. 248-260, 1993. doi: 10.1037/0022-3514.65.2.248.
[2]	R. Adolphs , “Cognitive neuroscience of human social behavior,” Nature Reviews. Neuroscience, vol. 4, no. 3, pp. 165-178, Mar. 2003. doi: 10.1038/nrn1056.
[3]	Y. C. Kuo, H. C. Chu, M. C. Tsai , “Effects of an integrated physiological signal-based attention-promoting and English listening system on students’ learning performance and behavioral patterns,” Computers in Human Behavior, vol.75, pp. 218-227, 2017. doi: 10.1016/j.chb.2017.05.017.
[4]	D. C. Mohr, M. Zhang, S. M. Schueller , “Personal sensing: Understanding mental health using ubiquitous sensors and machine learning,” Annual Review of Clinical Psychology, vol. 13, pp. 23-47, Mar. 2017. doi: 10.1146/annurev-clinpsy-032816-044949.
[5]	M. M. Bradley and P. J. Lang , “Measuring emotion：Behavior, feeling and physiology,” in Cognitive Neuroscience of Emotion, R. Lane and L. Nadel Eds. New York, USA: Oxford University Press, 2000, pp. 242-276.
[6]	G. H. Wu, G. Y. Liu, M. Hao , “The analysis of emotion recognition from GSR based on PSO,” in Proc. International Symposium on Intelligence Information Processing and Trusted Computing, Huanggang, China, Oct. 2010, pp. 360-363. doi: 10.1109/IPTC.2010.60.
[7]	W. H. Wen, G. Y. Liu, N. P. Cheng , et al., “Emotion recognition based on multi-variant correlation of physiological signals,” IEEE Transactions on Affective Computing, vol. 5, no. 2, pp. 126-140, Jun. 2014. doi: 10.1109/TAFFC.2014.2327617.
[8]	R. Reisenzein, E. Hudlicka, M. Dastani , et al., “Computational modeling of emotion: toward improving the inter and intradisciplinary exchange,” IEEE Transactions on Affective Computing, vol. 4, no. 3, pp. 246-266, May 2013. doi: 10.1109/T-AFFC.2013.14.
[9]	X. L. Peng, L. Xie, X. Liu , et al., “Emotional state transition model based on stimulus and personality characteristics,” China Communications, vol. 10, no. 6,pp. 146-155, Sept. 2013. doi: 10.1109/CC.2013.6549266.
[10]	C. Breazeal , “A motivational system for regulating human-robot interaction,” in Proc. National Conference on Artificial Intelligence, Madison, USA, Jul. 1998, pp. 54-62.
[11]	C. Lithari, C. A. Frantzidis, C. Papadelis , et al., “Small-world properties of brain functional connectivity networks are affected by emotional stimuli,” in Proc. IEEE International Conference on Information Technology and Applications in Biomedicine, Corfu, Greece, Nov. 2010, pp. 1-4. doi: 10.1109/ITAB.2010.5687815.
[12]	K. Salminen, J. Rantala, P. Laitinen , et al., “Emotional responses to haptic stimuli in laboratory versus travelling by bus contexts,” in Proc. International Conference on Affective Computing and Intelligent Interaction and Workshops, Amsterdam, Netherlands, Sept. 2009, pp. 1-7. doi: 10.1109/ACII.2009.5349597.
[13]	J. J. Gross , “Emotion regulation: affective, cognitive, and social consequences,” Psychophysiology, vol. 39, no. 3 , pp. 281-291, May 2002. doi: 10.1017/S0048577201393198.
[14]	S. Koelstra, C. Muhl, M. Soleymani , et al., “DEAP: A database for emotion analysis; using physiological signals,” IEEE Transactions on Affective Computing, vol. 3, no. 1, pp. 18-31, Jan. 2012. doi: 10.1109/T-AFFC.2011.15.
[15]	X. Hu, L. Xie, X. Liu, Z. L. Wang , “TI emotion expression of robot with personality,” Mathematical Problems in Engineering, no. 5, pp. 831-842, Aug. 2013. doi: 10.1155/2013/132735.
[16]	J.D. Morris , “SAM: The self-assessment manikin an efficient cross-cultural measurement of emotional response,” J. Advertising Research, vol. 35, no. 8, pp. 63-68, 1995.

Emotion and Cognitive Reappraisal Based on GSR Wearable Sensor

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

图/表 12

参考文献 16

相关文章 0

编辑推荐

Metrics