Microexpression
A microexpression is a brief, involuntary facial expression shown on the face of humans according to emotions experienced. They usually occur in high-stakes situations, where people have something to lose or gain. Microexpressions occur when a person is consciously trying to conceal all signs of how they are feeling, or when a person does not consciously know how they are feeling.[1][2] Unlike regular facial expressions, it is difficult/impossible to hide microexpression reactions. Microexpressions cannot be controlled as they happen in a fraction of a second, but it is possible to capture someone's expressions with a high speed camera and replay them at much slower speeds.[3] Microexpressions express the seven universal emotions: disgust, anger, fear, sadness, happiness, contempt, and surprise. Nevertheless, in the 1990s, Paul Ekman expanded his list of emotions, including a range of positive and negative emotions not all of which are encoded in facial muscles. These emotions are amusement, embarrassment, anxiety, guilt, pride, relief, contentment, pleasure, and shame.[4][5] They are very brief in duration, lasting only 1⁄25 to 1⁄15 of a second.[6]
History
Microexpressions were first discovered by Haggard and Isaacs. In their 1966 study, Haggard and Isaacs outlined how they discovered these "micromomentary" expressions while "scanning motion picture films of psychotherapy hours, searching for indications of non-verbal communication between therapist and patient"[7] Through a series of studies, Paul Ekman found a high agreement across members of diverse Western and Eastern literate cultures on selecting emotional labels that fit facial expressions. Expressions he found to be universal included those indicating anger, disgust, fear, happiness, sadness, and surprise. Findings on contempt are less clear, though there is at least some preliminary evidence that this emotion and its expression are universally recognized.[8] Working with his long-time friend Wallace V. Friesen, Ekman demonstrated that the findings extended to preliterate Fore tribesmen in Papua New Guinea, whose members could not have learned the meaning of expressions from exposure to media depictions of emotion.[9] Ekman and Friesen then demonstrated that certain emotions were exhibited with very specific display rules, culture-specific prescriptions about who can show which emotions to whom and when. These display rules could explain how cultural differences may conceal the universal effect of expression.[10]
In the 1960s, William S. Condon pioneered the study of interactions at the fraction-of-a-second level. In his famous research project, he scrutinized a four-and-a-half-second film segment frame by frame, where each frame represented 1/25th second. After studying this film segment for a year and a half, he discerned interactional micromovements, such as the wife moving her shoulder exactly as the husband's hands came up, which combined yielded microrhythms.[11]
Years after Condon's study, American psychologist John Gottman began video-recording living relationships to study how couples interact. By studying participants' facial expressions, Gottman was able to correlate expressions with which relationships would last and which would not.[12] Gottman's 2002 paper makes no claims to accuracy in terms of binary classification, and is instead a regression analysis of a two factor model where skin conductance levels and oral history narratives encodings are the only two statistically significant variables. Facial expressions using Ekman's encoding scheme were not statistically significant.[13] In Malcolm Gladwell's book Blink, Gottman states that there are four major emotional reactions that are destructive to a marriage: defensiveness which is described as a reaction toward a stimulus as if you were being attacked, stonewalling which is the behavior where a person refuses to communicate or cooperate with another,[14] criticism which is the practice of judging the merits and faults of a person, and contempt which is a general attitude that is a mixture of the primary emotions disgust and anger.[15] Among these four, Gottman considers contempt the most important of them all.[16]
Types
Microexpressions are typically classified based on how an expression is modified. They exist in three groups:
- Simulated expressions: when a microexpression is not accompanied by a genuine emotion. This is the most commonly studied form of microexpression because of its nature. It occurs when there is a brief flash of an expression, and then returns to a neutral state.[17]
- Neutralized expressions: when a genuine expression is suppressed and the face remains neutral. This type of micro-expression is not observable due to the successful suppression of it by a person.[17]
- Masked expressions: when a genuine expression is completely masked by a falsified expression. Masked expressions are microexpressions that are intended to be hidden, either subconsciously or consciously.[18]
In photographs and films
Microexpressions can be difficult to recognize, but still images and video can make them easier to perceive. In order to learn how to recognize the way that various emotions register across parts of the face, Ekman and Friesen recommend the study of what they call "facial blueprint photographs," photographic studies of "the same person showing all the emotions" under consistent photographic conditions.[19] However, because of their extremely short duration, by definition, microexpressions can happen too quickly to capture with traditional photography. Both Condon and Gottman compiled their seminal research by intensively reviewing film footage. Frame rate manipulation also allows the viewer to distinguish distinct emotions, as well as their stages and progressions, which would otherwise be too subtle to identify. This technique is demonstrated in the short film Thought Moments by Michael Simon Toon and a film in Malayalam Pretham 2016[20][21][22] Paul Ekman also has materials he has created on his website that teach people how to identify microexpressions using various photographs, including photos he took during his research period in New Guinea.[23]
Moods vs emotions
Moods differ from emotions in that the feelings involved last over a longer period. For example, a feeling of anger lasting for just a few minutes, or even for an hour, is called an emotion. But if the person remains angry all day, or becomes angry a dozen times during that day, or is angry for days, then it is a mood.[24] Many people describe this as a person being irritable, or that the person is in an angry mood. As Paul Ekman described, it is possible but unlikely for a person in this mood to show a complete anger facial expression. More often just a trace of that angry facial expression may be held over a considerable period-a tightened jaw or tensed lower eyelid, or lip pressed against lip, or brows drawn down and together.[25] Emotions are defined as a complex pattern of changes, including physiological arousal, feelings, cognitive processes, and behavioral reactions, made in response to a situation perceived to be personally significant.[26]
Controlled microexpressions
Facial expressions are not just uncontrolled instances. Some may be in fact voluntary, another involuntary; thus one may be truthful and another false.[27] Facial expression may be controlled or uncontrolled. Some people are born able to control their expressions (such as pathological liars), while others are trained, for example actors. "Natural liars" know about their ability to control microexpressions, and so do those who know them well. They have been getting away with things since childhood, fooling their parents, teachers, and friends when they wanted to.[28] People can simulate emotion expressions, attempting to create the impression that they feel an emotion when they are not experiencing it at all. A person may show an expression that looks like fear when in fact he feels nothing, or feels sadness or some other emotion.[29] Facial expressions of emotion are controlled for various reasons, whether cultural or by social conventions. For example, in the United States many little boys learn the cultural display rule, "little men do not cry or look afraid." There are also more personal display rules, not learned by most people within a culture, but the product of the idiosyncrasies of a particular family. A child may be taught never to look angrily at his father, or never to show sadness when disappointed. These display rules, whether cultural ones shared by most people or personal, individual ones, are usually so well-learned, and learned so early, that the control of the facial expression they dictate is done automatically without thinking or awareness.[30]
Emotional intelligence
Involuntary facial expressions can be hard to pick up and understand explicitly, and it is more of an implicit competence of the unconscious mind. Daniel Goleman created a conclusion on the capacity of an individual to recognize their own, as well as others' emotions, and to discriminate emotions based on introspection of those feelings. This is part of Goleman's emotional intelligence. In E.I. attunement is an unconscious synchrony that guides empathy, and report. attunement relies heavily on nonverbal communication.[31] Looping is where facial expressions can elicit involuntary behavior, In the research motor mimicry there shows neurons that pick up on facial expressions and communicate with motor neurons responsible for muscles in the face to display the same facial expression. Thus displaying a smile may elicit a micro expression of a smile on someone who is trying to remain neutral in their expression.[32] Through fMRI we can see the area where these Mirror neurons are located lights up when you show the subject an image of a face expressing an emotion using a mirror. In the relationship of the prefrontal cortex also known as the (executive mind) which is where cognitive thinking experience and the amygdala being part of the limbic system is responsible for involuntary functions, habits, and emotions. The amygdala can hijack the pre-frontal cortex in a sympathetic response. In his book Emotional Intelligence Goleman uses the case of Jason Haffizulla (who assaulted his high school physics teacher because of a grade he received on a test) as an example of an emotional hijacking this is where rationality and better judgement can be impaired.[31] This is one example of how the bottom brain can interpret sensory memory and execute involuntary behavior. This is the purpose of microexpressions in attunement and how you can interpret the emotion that is shown in a fraction of a second. The microexpression of a concealed emotion that's displayed to an individual will elicit the same emotion in them to a degree, this process is referred to as an emotional contagion.[32] Being able to introspect these emotions can have applications to having more accurate judgements on an individuals intentions although accuracy depends a lot of factors. Accuracy can be determined by an web based microemotional aptitude test called the Profile of Nonverbal Sensitivity (PONS) which is similar to the Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT) which tests the ability to read emotions.
MFETT and SFETT
Micro Facial expression training tools and subtle Facial expression training tools are software made to develop someone's skills in the competence of recognizing emotion. The software consists of a set of videos that you watch after being educated on the facial expressions. After watching a short clip, there is a test of your analysis of the video with immediate feedback. This tool is to be used daily to produce improvements. Individuals that are exposed to the test for the first time usually do poor trying to assume what expression was presented, but the idea is through the reinforcement of the feedback you unconsciously generate the correct expectations of that expression. These tools are used to develop rounder social skills and a better capacity for empathy. They are also quite useful for development of social skills in people on the autism spectrum.[32]
Lies and leakage
There is no sign of deceit itself. There is no gesture, facial expression, nor muscle twitch that itself indicates that a person is lying. There are only clues that the person is poorly prepared and that the clues of emotions do not fit what the person is saying. These are what provide clues of leakage or deception.[33] Microexpressions do not show what intentions or thoughts the deceiver is trying to conceal. They only provide the fact that there was emotional arousal in the context of the situation. If an individual displays fear or surprise in the form of a microexpression, it does not mean that the individual is concealing information that is relevant to investigation. This is similar to how polygraphs fail to some degree: because there is a sympathetic response due to the fear of being disbelieved as innocent. The same goes for micro expressions, when there is a concealed emotion there is no information revealed on why that emotion was felt. They do not determine a lie, but are a form of detecting concealed information. Dr. David Matsumoto explains that one must not conclude that someone is lying if a microexpression is detected but that there is more to the story than is being told.[34] Paul Ekman created a paradigm to determine the confidence in deception apprehension due to the context of the situation and the person to be the liar themselves. The situational factors can be the type of person, any relationships, or the type of lie they are telling, or whether it is the act of withholding information or telling a false information. If a lie is successful, it can be followed by expressions of false delight, which is when happiness expressed in the satisfaction of the deceiver, or deception guilt, which can come on as an expression of fear or sadness.
There are also behavioral signs of false expressions or when an emotional expression is not genuinely being felt. Usually these can be interpreted implicitly because they are out of synch, similar to when something feels off about what somebody says, but these sign can go unnoticed.
- Fear: when there is absence of the reliable forehead expression
- Sadness: when there is absence of the reliable forehead expression
- Happiness: lack of wrinkle around the eye (eye muscles not being involved)
- Negative emotions: absence of sympathetic somatic response.
- Any emotions: asymmetrical expression, onset of expression incongruent or abrupt.
Universality
A question commonly asked is whether facial expressions within microexpressions are universal no matter what their background. Charles Darwin wrote that facial expressions of emotion are universal, not learned differently in each culture; that they are biologically determined, the product of man's evolution.[35] Many writers have disagreed with this statement. David Matsumoto however agreed with this statement in his study of sighted and blind Olympians. Using thousands of photographs captured at the 2004 Olympic and Paralympic Games, Matsumoto compared the facial expressions of sighted and blind judo athletes, including individuals who were born blind. All competitors displayed the same expressions in response to winning and losing.[36] Matsumoto discovered that both blind and sighted competitors displayed similar facial expression, during winnings and loss. These results suggest that our ability to modify our faces to fit the social setting is not learned visually.[36] Paul Ekman did research to find out if there were 5 innate facial expressions that are not culturally learned. To do this he had to find an isolated preliterate community to show that the expressions displayed by the people that occupy that area can be interpreted in their expression to the same in how anyone globally could understand implicitly how they were feeling.
Facial Action Coding System
The Facial Action Coding System or FACS is used to identify facial expression. This identifies the muscles that produce the facial expressions. To measure the muscle movements the action unit (AU) was developed. This system measures the relaxation or contraction of each individual muscle and assigns a unit. More than one muscle can be grouped into an Action Unit or the muscle may be divided into separate action units. The score consists of duration, intensity and asymmetry. This can be useful in identifying depression or measurement of pain in patients that are unable to express themselves.[37]
The Facial Action Coding System training manual, first published in 1978 with multimedia supplements, is designed to teach individuals how to detect and categorize facial movements. The guide provides lessons and practice for memorizing action units and combinations of action units. The manual's purpose is to enable practitioners to recognize different physiological attributes of facial expressions, but leaves the interpretation of this data up to other works. Users should not expect to become face-reading experts. It can be particularly useful to behavioral scientists, CG animators, or computer scientists when they need to know the exact movements that the face can perform, and what muscles produce them. It also has potential to be a valuable tool for psychotherapists, interviewers, and other practitioners who must penetrate deeply into interpersonal communications.[38] A new version (2002) of FACS by Paul Ekman, Wallace V. Friesen, and Joseph C. Hager is now available with several core improvements, including more accurate representations of facial behaviors and cleaner, digital images. Other related tools for facial expression recognition training include the Micro Expression Training Tool (METT) and Subtle Expression Training Tool (SETT), both developed by Paul Ekman.[37]. The pioneer F-M Facial Action Coding System 2.0 (F-M FACS 2.0) [39] was created in 2017 by Dr. Freitas-Magalhães, and presents about 2,000 segments in 4K, using 3D technology and automatic and real-time recognition.
Wizards Project
In the Wizards Project, previously called the "Diogenes Project", Paul Ekman and Maureen O'Sullivan studied the ability of people to detect deception. Of the thousands of people tested, only a select few were able to accurately detect when someone was lying. The Wizards Project researchers named these people "Truth Wizards". To date, the Wizards Project has identified just over 50 people with this ability after testing nearly 20,000 people.[40] Truth Wizards use microexpressions, among many other cues, to determine if someone is being truthful. Scientists hope by studying wizards that they can further advance the techniques used to identify deception.
In popular culture
Microexpressions and associated science are the central premise for the 2009 television series Lie to Me, based on discoveries of Paul Ekman. The main character uses his acute awareness of microexpressions and other body language clues to determine when someone is lying or hiding something.
They also play a central role in Robert Ludlum's posthumously published The Ambler Warning, in which the central character, Harrison Ambler, is an intelligence agent who is able to see them. Similarly, one of the main characters in Alastair Reynolds' science fiction novel, Absolution Gap, Aura, can easily read microexpressions.
In The Mentalist, the main character, Patrick Jane, can often tell when people are being dishonest. However, specific reference to microexpressions is only made once in the 7th and final season.
In the 2015 science fiction thriller Ex Machina, Ava, an artificially intelligent humanoid, surprises the protagonist, Caleb, in their first meeting, when she tells him "Your microexpressions are telegraphing discomfort."
In the espionage novel Performance Anomalies,[41] the central character, Cono 7Q, has an accelerated nervous system due to mutations in several brain-related genes on chromosome 7; this enables him to perceive fleeting microexpressions as well as other hyper-fast phenomena.
Controversy
Though the study of microexpressions has gained popularity through popular media, studies show it lacks internal consistency in its conceptual formation.[42]
See also
References
- ↑ Freitas-Magalhães, A. (2012). Microexpression and macroexpression. In V. S. Ramachandran (ed.), Encyclopedia of Human Behavior (Vol. 2, pp. 173–183). Oxford: Elsevier/Academic Press. ISBN 978-0123750006
- ↑ Ekman, Paul (2003). Emotions Revealed. New York: Henry Holt and Co. p. 237.
- ↑ http://www.researchgate.net/publication/224160151_Facial_micro-expressions_recognition_using_high_speed_camera_and_3D-gradient_descriptor
- ↑ Ekman, Paul (1999). "Basic Emotions". In T. Dalgleish and M. Power. Handbook of Cognition and Emotion. Sussex, UK: John Wiley & Sons, Ltd.
- ↑ Ekman, Paul (1992). "Facial Expressions of Emotion: An Old Controversy and New Findings". Philosophical Transactions of the Royal Society. London. B335: 63–69. doi:10.1098/rstb.1992.0008.
- ↑ http://face.paulekman.com/aboutmett2.aspx
- ↑ Haggard, E. A., & Isaacs, K. S. (1966). Micro-momentary facial expressions as indicators of ego mechanisms in psychotherapy. In L. A. Gottschalk & A. H. Auerbach (Eds.), Methods of Research in Psychotherapy (pp. 154-165). New York: Appleton-Century-Crofts.
- ↑ Matsumoto, David (1992). "More evidence for the universality of a contempt expression". Motivation and Emotion. 16 (4).
- ↑ Ekman, P.; Friesen, W.V. (1971). "Constants across cultures in the face and emotion" (PDF). Journal of Personality and Social Psychology. 17 (2): 124–129. PMID 5542557. doi:10.1037/h0030377.
- ↑ Ekman, Paul (1989). H. Wagner & A Manstead, ed. Handbook of social psychophysiology. Chichester, England: Wiley. pp. 143–164. Chapter: The argument and evidence about universals in facial expressions of emotion.
- ↑ http://journals.lww.com/jonmd/Citation/1966/10000/Sound_Film_Analysis_of_Normal_and_Pathological.5.aspx Sound Film Analysis of Normal and Pathological Behavior Patterns, CONDON, W. S.; OGSTON, W. D., Journal of Nervous & Mental Disease. 143(4):338-347, October 1966.
- ↑ "Research FAQs | The Gottman Institute". Gottman.com. Retrieved 2013-10-26.
- ↑ Gottman, J. and Levenson, R.W., (2002). "A Two-Factor Model for Predicting When a Couple Will Divorce: Exploratory Analyses Using 14-Year Longitudinal Data", Family Process, 41 (1), pp. 83–96
- ↑ Webber, Elizabeth; Feinsilber, Mike (1999). Merriam-Webster's Dictionary of Allusions. Merriam-Webster. pp. 519–. ISBN 9780877796282. Retrieved 10 December 2012.
- ↑ TenHouten,W.D. (2007). General Theory of Emotions and Social Life. Routledge.
- ↑ Gladwell, Malcolm (2005). Blink, Chapter 1, Section 3, The Importance of Contempt
- 1 2 http://www.cse.usf.edu/~mshreve/publications/FG11.pdf
- ↑ Godavarthy, Sridhar. "Microexpression spotting in video using optical strain". Web. Retrieved 15 June 2011.
- ↑ Ekman, P., & Friesen, W. V. (2003). Unmasking the Face. Cambridge: Malor Books., p.169
- ↑ Prof. Ragodí. "Trabajo Psicología de 1er Trimestre." El Bigote de Bernays. Blogspot. Updated 11-19-2009. Accessed 8-5-13. http://elbigotedebernays.blogspot.com/2009/11/trabajo-psicologia-1er-trimestre.html
- ↑ Braun, Roman. "Eye Catcher." Trinergy-NLP-Blog. Posted 10-27-2009. Accessed 8-5-13. "Archived copy". Archived from the original on 2013-12-13. Retrieved 2013-08-06.
- ↑ "Thought Moments." British Films Directory. British Council. Updated 12-1-2009. http://film.britishcouncil.org/thought-moments
- ↑ http://www.paulekman.com/products/
- ↑ Ekman, P., & Friesen, W. V. (2003). Unmasking the Face. Cambridge: Malor Books., p.12.
- ↑ Ekman, P., & Friesen, W. V. (2003). Unmasking the Face. Cambridge: Malor Books. p.12-13.
- ↑ http://www.apa.org/research/action/glossary.aspx#e
- ↑ Ekman, P., & Friesen, W. V. (2003). Unmasking the Face. Cambridge: Malor Books., p.19.
- ↑ Ekman, P. (1991). Telling Lies Clues to deceit in the Marketplace, Politics, and Marriage. New York: W.W. Norton & Company Inc., p.56.
- ↑ Ekman, P., & Friesen, W. V. (2003). Unmasking the Face. Cambridge: Malor Books., p.20.
- ↑ Ekman, P., & Friesen, W. V. (2003). Unmasking the Face. Cambridge: Malor Books. p.20-21.
- 1 2 Goleman, Daniel (1995). Emotional intelligence. New York: Bantam Books.
- 1 2 3 Goleman, Daniel (2006). Social intelligence: the new science of human relationships. New York: Bantam Books.
- ↑ Ekman, P. (1991). Telling Lies Clues to deceit in the Marketplace, Politics, and Marriage. New York: W.W. Norton & Company Inc., p.80.
- ↑ Matsumoto, D. (2010, March 21). Dr. David Matsumoto: How to Tell a Lie with the Naked Eye. Retrieved from Spying for Lying: http://www.spyingforlying.com/2010/03/dr-david-matsumoto-how-to-tell-lie-with.html
- ↑ Darwin, C. (1872). The Expression of the Emotions in Man and Animals. London: John Murray.
- 1 2 Bible, E. (2009, January 7). Smiles and frowns are innate, not learned. Retrieved from San Francisco State University: http://www.sfsu.edu/news/2009/spring/1.html
- 1 2 http://www.paulekman.com/facs/
- ↑ "Facial Action Coding System (FACS) and the FACS Manual". Face-and-emotion.com. Archived from the original on 2013-10-19. Retrieved 2013-10-26.
- ↑ Freitas-Magalhães, A. (2017). Facial Action Coding System 2.0: Manual of Scientific Codification of the Human Face. Porto: FEELab Science Books. ISBN 978-989-8766-86-1.
- ↑ Camilleri, J., Truth Wizard knows when you've been lying", Chicago Sun-Times, January 21, 2009
- ↑ Lee, Victor Robert (2012-08-29). Performance Anomalies. Mercury Frontline LLC. ISBN 9781938409219.
- ↑ http://pss.sagepub.com/content/19/5/508.abstract
External links
- Lying Is Exposed By Microexpressions We Can't Control, Science Daily, May 2006
- The Naked Face
- Facial Expressions Test based on "The Micro Expression Training Tool"
- "A Look Tells All" in Scientific American Mind October 2006
- Microexpressions Complicate Face Reading, by Medical News Today August 2007
- Deception Detection, American Psychological Association