Artificial Intelligence and the Illusion of Understanding: A Systematic Review of Theory of Mind and Large Language Models.
The development of Large Language Models (LLMs) has sparked significant debate regarding their capacity for Theory of Mind (ToM)—the ability to attribute mental states to oneself and others. This systematic review examines the extent to which LLMs exhibit Artificial ToM (AToM) by evaluating their pe...
| Publicado en: | CyberPsychology, Behavior & Social Networking Vol. 28; no. 7; pp. 505 - 515 |
|---|---|
| Autores principales: | , , , , |
| Formato: | research systematic review tables/charts Journal Article |
| Publicado: |
Mary Ann Liebert, Inc.
Jul2025
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=186341774&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 186341774 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 21522715 BABN jtl: CyberPsychology, Behavior & Social Networking issn: 21522715 maglogo: N pubinfo: dt: Jul2025 vid: 28 iid: 7 pid: 1365 pub: Mary Ann Liebert, Inc. place: New Rochelle, New York artinfo: ui: 186341774 186341774 186341774 10.1089/cyber.2024.0536 186341774 ppf: 505 ppct: 10 formats: tig: atl: Artificial Intelligence and the Illusion of Understanding: A Systematic Review of Theory of Mind and Large Language Models. aug: au: Marchetti, Antonella Manzi, Federico Riva, Giuseppe Gaggioli, Andrea Massaro, Davide affil: Department of Psychology, Research Center on Theory of Mind and Social Competences in the Lifespan, Università Cattolica del Sacro Cuore, Milan, Italy. sug: subj: Artificial Intelligence Readability Language Theory of Mind Computer Simulation Task Performance and Analysis Human Funding Source Systematic Review Natural Language Processing Social Cognition Psychology Information Science Mental Processes Semantics Problem Solving Epistemology User-Computer Interface Research, Interdisciplinary Cognition Descriptive Statistics ab: The development of Large Language Models (LLMs) has sparked significant debate regarding their capacity for Theory of Mind (ToM)—the ability to attribute mental states to oneself and others. This systematic review examines the extent to which LLMs exhibit Artificial ToM (AToM) by evaluating their performance on ToM tasks and comparing it with human responses. While LLMs, particularly GPT-4, perform well on first-order false belief tasks, they struggle with more complex reasoning, such as second-order beliefs and recursive inferences, where humans consistently outperform them. Moreover, the review underscores the variability in ToM assessments, as many studies adapt classical tasks for LLMs, raising concerns about comparability with human ToM. Most evaluations remain constrained to text-based tasks, overlooking embodied and multimodal dimensions crucial to human social cognition. This review discusses the "illusion of understanding" in LLMs for two primary reasons: First, their lack of the developmental and cognitive mechanisms necessary for genuine ToM, and second, methodological biases in test designs that favor LLMs' strengths, limiting direct comparisons with human performance. The findings highlight the need for more ecologically valid assessments and interdisciplinary research to better delineate the limitations and potential of AToM. This set of issues is highly relevant to psychology, as language is generally considered just one component in the broader development of human ToM, a perspective that contrasts with the dominant approach in AToM studies. This discrepancy raises critical questions about the extent to which human ToM and AToM are comparable. pubtype: Academic Journal doctype: research systematic review tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|