We developed an interactive system with dialog function that can analyze emotions of the user and response to him/her with facial expressions. The dialog system is due to our Emotion Generating Calculations (EGC) method based on the Elliot's Emotion Eliciting Condition Theory. The proposed method can judge whether an event is pleasant or not and obtain each attribute value for 20 various emotions under that situation. Successfully, we consider adjective relation and adverbial phrases and we input their attributes into the EGC, such that we can evaluate strength of each emotion.
This system can depict the face according to the context of conversation. Although each attribute value in EGC shows one aspect of feeling, we must integrate those attributes to express human-like emotions. We applied a fuzzy reasoning model for selecting the face proposed by T.Yamashita. In this method, nine faces with three levels of brow and eye deflection and three levels of mouth deflection were used to construct the fuzzy reasoning model. In this study, we extended Yamashita's system with eight emotions to a sophisticated system with 20 emotions by neural network.