Identifying Basic Emotions and Action Units from Facial Photographs with ChatGPT.
Recognising facial expressions of emotion is crucial for social interactions. In addition, identifying these expressions underlies the study of social cognition, consumer behaviour, and many other fields. Using automated facial coding (AFC), this task can be completed more efficiently while potentia...
| Publicado en: | Journal of Nonverbal Behavior Vol. 49; no. 2; pp. 289 - 307 |
|---|---|
| Autor principal: | |
| Formato: | Artículo |
| Publicado: |
Springer Nature
Jun2025
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=185303620&site=ehost-live header: @attributes: shortDbName: ssf uiTerm: 185303620 longDbName: Social Sciences Full Text (H.W. Wilson) uiTag: AN controlInfo: bkinfo: jinfo: jid: 01915886 JNV jtl: Journal of Nonverbal Behavior issn: 01915886 maglogo: N pubinfo: dt: Jun2025 vid: 49 iid: 2 pid: 237 pub: Springer Nature artinfo: ui: 185303620 10.1007/s10919-025-00484-1 ppf: 289 ppct: 18 formats: fmt: – @attributes: type: T – @attributes: type: P size: 989KB tig: atl: Identifying Basic Emotions and Action Units from Facial Photographs with ChatGPT. aug: au: Kramer, Robin S. S. affil: https://ror.org/03yeq9x20 University of Lincoln, Lincoln, UK su: Fear Sadness Anger Emotions Facial expression Generative artificial intelligence Computer software Photography Descriptive statistics Experimental design Statistical reliability Data analysis software Chatbots sug: subj: Fear Sadness Anger Emotions Facial expression Computer, computer peripheral and pre-packaged software merchant wholesalers Computer and Computer Peripheral Equipment and Software Merchant Wholesalers Computer and software stores Software publishers (except video game publishers) Generative artificial intelligence Computer software Photography Descriptive statistics Experimental design Statistical reliability Data analysis software Chatbots keyword: Action unit Basic emotion ChatGPT Facial action coding system Psychology and Cognitive Sciences Psychology Action unit Basic emotion ChatGPT Facial action coding system Psychology and Cognitive Sciences Psychology ab: Recognising facial expressions of emotion is crucial for social interactions. In addition, identifying these expressions underlies the study of social cognition, consumer behaviour, and many other fields. Using automated facial coding (AFC), this task can be completed more efficiently while potentially benefitting human-computer interactions. Here, I explored ChatGPT's ability to recognise expressions of basic emotions using high quality images for which human performance, as well as that of FaceReader (a commercially available software), had previously been collected. In Experiment 1, a forced-choice labelling task found that ChatGPT outperformed both humans and FaceReader in identifying the intended emotions from their expressions. Experiment 2 focussed on the facial action coding system (FACS), requiring ChatGPT to identify activated action units (AUs) and their intensities from these same images. The chatbot's overall agreement with a FACS-certified specialist was at least as high as FaceReader, and was around the criterion required for human certification. Further, ChatGPT's detection of a large subset of AUs showed good or very good agreement with the specialist's coding, comparable with FaceReader's performance. Finally, although overall intensity ratings showed relatively poor agreement with the human specialist, ratings for several of the AUs agreed well with human coding, especially if a small level of tolerance were acceptable. Taken together, ChatGPT's ability to perceive human facial expressions and their AUs from high quality images provides a possible alternative to current AFC tools, as well as an interesting avenue for investigation regarding advances in human-computer interactions. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: N holdings: @attributes: islocal: N |
|---|