https://www.noldus.com/facereader/facial-action-units


Facial Action Coding System (FACS)

The Facial Action Coding System (FACS) is the most comprehensive and objective facial coding system available to social scientists. Traditionally a manual coding system, which quantifies all possible movements a person can make with his or her face.

Check out what Facial Action Units look like!

Recent advances in computer vision have allowed for reliable automated facial action coding. Below you can see the 20 Action Units offered in the most recent version of FaceReader as well as some frequently occurring or difficult action unit combinations.  Some images have been zoomed in on the area of interest to explicitly show what muscle movement corresponds to the specific Facial Action Unit. 

Traditionally a very time-consuming task, reliable action unit coding is automated using FaceReader.

Inner brow raiser

AU 1. Inner Brow Raiser

Contributes to the emotions sadness, surprise, and fear, and to the affective attitude interest. Muscular basis: frontalis (pars medialis).

Outer brow raiser

AU 2. Outer Brow Raiser

Contributes to the emotions surprise and fear, and to the affective attitude interest. Frontalis (pars lateralis) is the underlying facial muscle.

Brow lowerer

AU 4. Brow Lowerer

Contributes to sadness, fear, and anger, and to confusion. Muscles: depressor glabellae, depressor supercilii, and corrugator supercilii.

Upper lid raiser

AU 5. Upper Lid Raiser

Contributes to surprise, fear, and anger, and to interest. Muscular basis: levator palpebrae superioris, and superior tarsal muscle.

Cheek raiser

AU 6. Cheek Raiser

Contributes to the emotion happiness. Orbicularis oculi (pars orbitalis) is the underlying facial muscle.

Lid tightener

AU 7. Lid Tightener

Contributes to the emotions fear and anger, and to confusion. Orbicularis oculi (pars palpebralis) is the underlying facial muscle.

Nose wrinkler

AU 9. Nose Wrinkler

Contributes to the emotion disgust. Levator labii superioris alaeque nasi are the underlying facial muscles.

Upper lip raiser

AU 10. Upper Lip Raiser

Levator labii superioris, caput infraorbitalis are the underlying facial muscles.

Lip corner puller

AU 12. Lip Corner Puller

Contributes to the emotion happiness and contempt when the action appears unilateraly. Muscular basis: zygomaticus major.

Dimpler

AU 14. Dimpler

Contributes to the emotion contempt when the action appears unilateraly, and to boredom. Buccinator is the underlying muscle.

Lip Corner Depressor

AU 15. Lip Corner Depressor

Contributes to the emotions sadness and disgust, and to confusion. Depressor anguli oris is the underlying muscle.

Chin Raiser

AU 17. Chin Raiser

This Action Unit contributes to the affective attitudes interest and confusion. The underlying facial muscle is mentalis.

Lip Pucker

AU 18. Lip Pucker

The underlying facial muscles are incisivii labii superioris and incisivii labii inferioris.

Lip Stretcher

AU 20. Lip Stretcher

Contributes to the emotion fear. The underlying facial muscle is risorius w/ platysma.

Lip Tightener

AU 23. Lip Tightener

Contributes to the emotion anger, and to the affective attitudes confusion and boredom. Muscular basis: orbicularis oris.

Lip Pressor

AU 24. Lip Pressor

This Action Unit contributes to the affective attitude boredom. The underlying facial muscle is orbicularis oris.

Lips Part

AU 25. Lips Part

The muscular basis consists of depressor labii inferioris, or relaxation of mentalis or orbicularis oris.

Jaw drop

AU 26. Jaw drop

Contributes to the emotions surprise and fear. Muscular basis: masseter; relaxed temporalis and internal pterygoid.

Mouth Stretch

AU 27. Mouth Stretch

The underlying facial muscle are pterygoids and digastric.

Eyes Closed

AU 43. Eyes Closed

Contributes to the affective attitude boredom. The muscular basis consists of relaxation of Levator palpebrae superioris.

Combinations of action units:

1, 2, 4

AU 1 - 2 - 4

Contributes to the emotions fear and can be recognized by the wavy pattern of the wrinkles across the forehead.

1, 2

AU 1 - 2

Contributes to the emotion surprise and can be recognized by a smooth line formed by the wrinkles across the forehead.

1, 4

AU 1 - 4

Contributes to sadness. Recognizable by a wavy pattern of the wrinkles in the center of the forehead. Eye-brows come together and up.

4, 5

AU 4 - 5

Contribute to the emotion anger.

6, 12

AU 6 - 12

Contributes to happiness. Notice the wrinkles around the eyes caused by cheek raising, also know as the "Duchenne Marker".

10, 25

AU 10 - 25

Contributes to the emotion disgust. When AU10 is activated intensily, it causes the lips to part as the upper lip raises.

18, 23

AU 18 - 23

Often confused as solely AU18. Notice the lips almost appear to be pulled by a single string outward (AU18) and then tightened (AU23).

23, 24

AU 23 - 24

The AUs marking lip movements are often the hardest to code. The lips are being pushed together (AU24) and tightened (AU23)

Reference

Ekman, P.; Friesen, W. V.; Hager, J. C. (2002). Facial action coding system: The manual on CD-ROM. Instructor’s Guide. Salt Lake City: Network Information Research Co.


Posted by sunnysmileHJ
,
출처  https://imotions.com/blog/facial-expression-pictures/

Pictures and facial movements

In the pictures below, “Lie To Me” star Tim Roth demonstrates the categorical expressions reflecting a specific emotion (all photographs © 2008-2009 Twentieth Century Fox Film).

The facial features that underlie the emotional expression are highlighted in this list of facial expressions pictures:

happiness

 

anger

 

surprise

 

fear

 

disgust

 

sadness

 

contempt

 

The idea behind facial expressions: Facial movements

A facial movement is the movement of one or more facial muscles. When we smile, for example, the zygomatic major muscle contracts. This muscle pulls our lips up and back towards our ears.

face muscles

The mapping between facial movements and facial muscles is not one-to-one. While some facial movements involve the synchronous contraction of one or two muscles, others comprise complex contraction patterns of several muscles.

 

At the core: Facial expressions and emotions

To the human eye, these muscular contraction patterns are apparent as facial expressions reflecting our current emotional state – angry, happy, sad, fearful, surprised, disgusted or contemptuous.

Built on groundbreaking academic research, these universal facial expressions, and the underlying emotional states can be determined via computer-based facial coding engines: Like expert human facial coders, the engines have initially been trained on facial expressions using an incredibly large picture and video repositories and databases.

One of the most typical and publicly available databases is the CK+ (“Cohn-Kanade”), developed by Carnegie Mellon University (Lucey et al., 2010). It is a standard benchmark for facial expression recognition that includes both posed and spontaneous expressions. One of the core strengths is that it has been extensively benchmarked in performance compared to expert human coders. Click here to get more information on the CK+.

Knowing the facial expressions of hundreds of thousands of humans across the globe, automatic facial expression engines are able to compare your current facial expression with the “ideal” expression of joy, anger, sadness, fear, surprise, disgust, or contempt. Think of this as a percentage score of how likely your current expression reflects an emotion and can be classified as, say, joy.

If you would like to learn more about computer-based facial expression recognition, reach out to our experts at iMotions.


Posted by sunnysmileHJ
,

출처: https://imotions.com/blog/facial-action-coding-system/



다시 정리 예정. 

Main Action Units

Action UnitDescriptionFacial MuscleExample (Hover to Play)
 1Inner Brow RaiserFrontalis, pars medialis
AU1 FACSGIF
 2Outer Brow Raiser (unilateral, right side)Frontalis, pars lateralis
AU2 right only FACSGIF
 4Brow LowererDepressor Glabellae, Depressor Supercilli, Currugator
au4 brow lowererGIF
 5Upper Lid RaiserLevator palpebrae superioris
AU5 FACSGIF
 6Cheek RaiserOrbicularis oculi, pars orbitalis
AU6 cheek raiserGIF
 7Lid TightenerOrbicularis oculi, pars palpebralis
AU7 lid tightenerGIF
 9 (also shows slight AU4 and AU10)Nose Wrinkler Levator labii superioris alaquae nasi
AU9 with 4+10GIF
 10 (also shows slight AU25)Upper Lip RaiserLevator Labii Superioris, Caput infraorbitalis
 AU10 with 25GIF
 11Nasolabial DeepenerZygomatic Minor
 12Lip Corner PullerZygomatic Major
AU12GIF
 13Cheek PufferLevator anguli oris (Caninus)
AU13 cheek pufferGIF
 14DimplerBuccinator
 15Lip Corner DepressorDepressor anguli oris (Triangularis)
AU15 FACSGIF
 16 (with AU25)Lower Lip DepressorDepressor labii inferioris
 17Chin RaiserMentalis
AU17 FACS guideGIF
 18 (with slight AU22 and AU25)Lip PuckererIncisivii labii superioris and Incisivii labii inferioris
AU18 with 22A and 25AGIF
 20Lip stretcherRisorius 
AU20 lip stretcherGIF
 22 (with AU25)Lip FunnelerOrbicularis oris
AU22 with 25 FACSGIF
 23Lip TightenerOrbicularis oris
 24Lip PressorOrbicularis oris
AU24 image FACS guideGIF
 25Lips partDepressor Labii, Relaxation of Mentalis (AU17), Orbicularis Oris
 26 (with AU25)Jaw DropMasetter; Temporal and Internal Pterygoid relaxed
AU26 with 25 FACS affectivaGIF
 27Mouth StretchPterygoids, Digastric
AU27 mouth stretcherGIF
 28 (with AU26)Lip SuckOrbicularis oris
AU28 with 26 FACS affectivaGIF
 41Lid droopRelaxation of Levator Palpebrae Superioris
42SlitOrbicularis oculi
AU42 slitGIF
 43Eyes ClosedRelaxation of Levator Palpebrae Superioris
AU43 eyes closedGIF
 44SquintOrbicularis oculi, pars palpebralis
 45BlinkRelaxation of Levator Palpebrae and Contraction of Orbicularis Oculi, Pars Palpebralis.
 AU45 blinkGIF
 46WinkLevator palpebrae superioris; Orbicularis oculi, pars palpebralis
AU46 winkGIF

 

Head Movement Action Units

Action UnitDescriptionExample (Hover to Play)
 51Head Turn Left
AU51 head turn leftGIF
 52Head Turn Right
AU52 head turn rightGIF
 53Head Up
AU53 head upGIF
 54Head Down
AU54 head downGIF
 55Head Tilt Left
AU55 head tilt leftGIF
 56Head Tilt Right
AU56 head tilt rightGIF
 57Head Forward
AU57 head forwardGIF
 58Head Back
 AU58 head backGIF

 

Eye Movement Action Units

Action UnitDescriptionExample (Hover to Play)
 51Eyes Turn Left
AU61-eyes-turn-leftGIF
 51Eyes Turn Right
AU62 eyes rightGIF
 51Eyes Up
AU63 eyes upGIF
 51Eyes Down
AU64 eyes downGIF

Emotions and Action Units

The Action Units described above show the different movements of facial muscles. Certain combined movements of these facial muscles pertain to a displayed emotion. Emotion recognition is completed in iMotions using Affectiva or Emotient, which uses the collection of certain action units to provide information about which emotion is being displayed. For example, happiness is calculated from the combination of action unit 6 (cheek raiser) and 12 (lip corner puller). A complete list of these combinations and the emotion that they relate to is shown below. The gifs on the right are shown in the same order that the action units listed.

EmotionAction UnitsDescriptionExamples (Hover to Play)
Happiness / Joy6 + 12Cheek Raiser, Lip Corner Puller

AU12 lip corner pullerGIF

Sadness1 + 4 + 15Inner Brow Raiser, Brow Lowerer, Lip Corner Depressor
AU1 inner brow raiserGIF

au4 brow lowererGIF

AU15 lip corner depressorGIF

Surprise1 + 2 + 5 + 26Inner Brow Raiser, Outer Brow Raiser, Upper Lid Raiser, Jaw Drop
AU1 inner brow raiserGIF

au2 outer brow raiserGIF

au5 upper lid raiserGIF

AU26 jaw dropGIF

Fear1 + 2 + 4 + 5 + 7 + 20 + 26Inner Brow Raiser, Outer Brow Raiser, Brow Lowerer, Upper Lid Raiser, Lid Tightener, Lip Stretcher, Jaw Drop
AU1 inner brow raiserGIF

au2 outer brow raiserGIF

au4 brow lowererGIF

au5 upper lid raiserGIF

AU7 lid tightenerGIF

AU20 lip stretcherGIF

AU26 jaw dropGIF

Anger4 + 5 + 7 + 23Brow Lowerer, Upper Lid Raiser, Lid Tightener, Lip Tightener
au4 brow lowererGIF

au5 upper lid raiserGIF

AU7 lid tightenerGIF

AU23 lip tightenerGIF

Disgust9 + 15 + 16Nose Wrinkler, Lip Corner Depressor, Lower Lip Depressor
AU9 nose wrinklerGIF

AU15 lip corner depressorGIF

AU16 lower lip depressorGIF

Contempt12 + 14 (on one side of the face)Lip Corner Puller, Dimpler
AU12 lip corner pullerGIF

AU14 dimplerGIF



Posted by sunnysmileHJ
,