Suppressed Negative-Emotion-Detecting Method by using Transitions in Facial Expressions and Acoustic Features

URI http://harp.lib.hiroshima-u.ac.jp/hiroshima-cu/metadata/12398
ファイル
タイトル
Suppressed Negative-Emotion-Detecting Method by using Transitions in Facial Expressions and Acoustic Features
著者
氏名 UEMURA Joji
ヨミ ウエムラ ジョウジ
別名 上村 譲史
氏名 MERA Kazuya
ヨミ メラ カズヤ
別名 目良 和也
氏名 KUROSAWA Yoshiaki
ヨミ クロサワ ヨシアキ
別名 黒澤 義明
氏名 TAKEZAWA Toshiyuki
ヨミ タケザワ トシユキ
別名 竹澤 寿幸
キーワード
emotion recognition
transition of facial expression
micro expression
acoustic feature
suppressed emotion
抄録

We propose a method of detecting suppressed/concealed negative emotion during compliment utterance. When people suppress/conceal emotions, very brief facial expressions called “micro expression” often appear. In order to detect such short-duration facial expression, we propose 90 features calculated from the contours of likelihood ratios for each of the five emotions (happiness, sadness, surprise, anger, and neutral). Likelihood ratios are calculated from still images in a video every 100 milliseconds. Furthermore, 384 acoustic features are calculated for multimodal analysis. Three machine learning classifiers by Support Vector Machines were constructed by using feature sets consist of facial-expression-transition, voice, and both of them, and the classifiers were evaluated how they can detect insincere compliments in Japanese. The experimental results indicate that the feature set including both of facial-expression-transition and voice was the most superior. Its precision and recall of insincerity detection and the total accuracy rate were 0.50, 0.44, and 0.64, respectively. The results were better than the annotation results by non-expert participants.

内容記述

The Second Workshop on Processing Emotions, Decisions and Opinions (EDO 2017) The 8th Language and Technology Conference (LTC) 2017/11/17, Poznań, Poland

最優秀論文賞(Best Paper Award)受賞論文

査読の有無
掲載雑誌名
The Second Workshop on Processing Emotions, Decisions and Opinions (EDO 2017)
開始ページ
122
終了ページ
127
出版年月日
2017.11.17
出版者
The 8th Language and Technology Conference (LTC)
本文言語
英語
資料タイプ
会議発表論文
著者版フラグ
出版社版
区分
hiroshima-cu