Suppressed Negative-Emotion-Detecting Method by using Transitions in Facial Expressions and Acoustic Features

URI http://harp.lib.hiroshima-u.ac.jp/hiroshima-cu/metadata/12398
File
Title
Suppressed Negative-Emotion-Detecting Method by using Transitions in Facial Expressions and Acoustic Features
Author
氏名 UEMURA Joji
ヨミ ウエムラ ジョウジ
別名 上村 譲史
氏名 MERA Kazuya
ヨミ メラ カズヤ
別名 目良 和也
氏名 KUROSAWA Yoshiaki
ヨミ クロサワ ヨシアキ
別名 黒澤 義明
氏名 TAKEZAWA Toshiyuki
ヨミ タケザワ トシユキ
別名 竹澤 寿幸
Subject
emotion recognition
transition of facial expression
micro expression
acoustic feature
suppressed emotion
Abstract

We propose a method of detecting suppressed/concealed negative emotion during compliment utterance. When people suppress/conceal emotions, very brief facial expressions called “micro expression” often appear. In order to detect such short-duration facial expression, we propose 90 features calculated from the contours of likelihood ratios for each of the five emotions (happiness, sadness, surprise, anger, and neutral). Likelihood ratios are calculated from still images in a video every 100 milliseconds. Furthermore, 384 acoustic features are calculated for multimodal analysis. Three machine learning classifiers by Support Vector Machines were constructed by using feature sets consist of facial-expression-transition, voice, and both of them, and the classifiers were evaluated how they can detect insincere compliments in Japanese. The experimental results indicate that the feature set including both of facial-expression-transition and voice was the most superior. Its precision and recall of insincerity detection and the total accuracy rate were 0.50, 0.44, and 0.64, respectively. The results were better than the annotation results by non-expert participants.

Description

The Second Workshop on Processing Emotions, Decisions and Opinions (EDO 2017) The 8th Language and Technology Conference (LTC) 2017/11/17, Poznań, Poland

最優秀論文賞(Best Paper Award)受賞論文

Description Peer Reviewed
Journal Title
The Second Workshop on Processing Emotions, Decisions and Opinions (EDO 2017)
Spage
122
Epage
127
Published Date
2017.11.17
Publisher
The 8th Language and Technology Conference (LTC)
Language
eng
NIIType
Conference Paper
Text Version
出版社版
Set
hiroshima-cu