A facial expression emotion recognition based human-robot interaction(FEER-HRI) system is proposed, for which a four-layer system framework is designed. The FEERHRI system enables the robots not only to recognize huma...A facial expression emotion recognition based human-robot interaction(FEER-HRI) system is proposed, for which a four-layer system framework is designed. The FEERHRI system enables the robots not only to recognize human emotions, but also to generate facial expression for adapting to human emotions. A facial emotion recognition method based on2D-Gabor, uniform local binary pattern(LBP) operator, and multiclass extreme learning machine(ELM) classifier is presented,which is applied to real-time facial expression recognition for robots. Facial expressions of robots are represented by simple cartoon symbols and displayed by a LED screen equipped in the robots, which can be easily understood by human. Four scenarios,i.e., guiding, entertainment, home service and scene simulation are performed in the human-robot interaction experiment, in which smooth communication is realized by facial expression recognition of humans and facial expression generation of robots within 2 seconds. As a few prospective applications, the FEERHRI system can be applied in home service, smart home, safe driving, and so on.展开更多
This study is to introduce concepts of energy and entropy to describe a robot＇s emoton decisien. It chooses the dimensional approach based on factors of pleasure and arousal for the merit of the interpolation between...This study is to introduce concepts of energy and entropy to describe a robot＇s emoton decisien. It chooses the dimensional approach based on factors of pleasure and arousal for the merit of the interpolation between enotions. Especially, Circumplex model which has also two axes： pleasure and arousal is used. Besides, the model indicates how emotions are distributed in the two-dimensional plane. Then by the definition of psychodynamicsthe energy states （mental energy and physical energy） are matched to pleasure and arousal respectively that are the basis of Circumplex model. The mental energy is updated by the result of Prospect theory which measures the value of gain and loss as pleasure factor. And the physical energy is updated by the result of hedonic scaling which measures levels of arousal from pleasure computed by Prospect theory, and the result of intensity of stimuli. Then the energy states are fed by entropy. The feedback loop by entropy satisfies the 2nd law of thermodynamics. The energy states generated by stimuli and fed by entropy take a position in the plane of Circumplex model. Then distances between the current position and other emotions are cornputed to get a level of each emotion, proportional to the inverse of the distance.展开更多
基金supported by the National Natural Science Foundation of China(61403422,61273102)the Hubei Provincial Natural Science Foundation of China(2015CFA010)+1 种基金the Ⅲ Project(B17040)the Fundamental Research Funds for National University,China University of Geosciences(Wuhan)
文摘A facial expression emotion recognition based human-robot interaction(FEER-HRI) system is proposed, for which a four-layer system framework is designed. The FEERHRI system enables the robots not only to recognize human emotions, but also to generate facial expression for adapting to human emotions. A facial emotion recognition method based on2D-Gabor, uniform local binary pattern(LBP) operator, and multiclass extreme learning machine(ELM) classifier is presented,which is applied to real-time facial expression recognition for robots. Facial expressions of robots are represented by simple cartoon symbols and displayed by a LED screen equipped in the robots, which can be easily understood by human. Four scenarios,i.e., guiding, entertainment, home service and scene simulation are performed in the human-robot interaction experiment, in which smooth communication is realized by facial expression recognition of humans and facial expression generation of robots within 2 seconds. As a few prospective applications, the FEERHRI system can be applied in home service, smart home, safe driving, and so on.
基金supported by the MKE(The Ministry of Knowledge Economy),Korea,under the ITRC(Information Technology Research Center)support program supervised by the NIPA(National IT Industry Promotion Agency)(NIPA-2009-(C1090-0902-0007))
文摘This study is to introduce concepts of energy and entropy to describe a robot＇s emoton decisien. It chooses the dimensional approach based on factors of pleasure and arousal for the merit of the interpolation between enotions. Especially, Circumplex model which has also two axes： pleasure and arousal is used. Besides, the model indicates how emotions are distributed in the two-dimensional plane. Then by the definition of psychodynamicsthe energy states （mental energy and physical energy） are matched to pleasure and arousal respectively that are the basis of Circumplex model. The mental energy is updated by the result of Prospect theory which measures the value of gain and loss as pleasure factor. And the physical energy is updated by the result of hedonic scaling which measures levels of arousal from pleasure computed by Prospect theory, and the result of intensity of stimuli. Then the energy states are fed by entropy. The feedback loop by entropy satisfies the 2nd law of thermodynamics. The energy states generated by stimuli and fed by entropy take a position in the plane of Circumplex model. Then distances between the current position and other emotions are cornputed to get a level of each emotion, proportional to the inverse of the distance.
