Addressing Autonomy Risks in Generative Chatbots with the Socratic Method.

Autonomy is a fundamental ethical principle in artificial intelligence (AI) ethics. Current discussions regarding autonomy-related risks in human–AI interaction, as well as potential mitigation strategies, have mainly focused on recommendation systems and algorithmic decision-making systems. However...

Descripción completa

Detalles Bibliográficos
Publicado en:Science & Engineering Ethics Vol. 31; no. 6; pp. 1 - 27
Autores principales: Lu, Wencheng, Hu, Zhenni
Formato: Artículo
Publicado: Springer Nature Dec2025
Materias:
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=190563989&site=ehost-live
header:
  @attributes:
    shortDbName: hlh
    uiTerm: 190563989
    longDbName: Humanities International Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    jinfo:
      jid:
        13533452
        GNI
      jtl: Science & Engineering Ethics
      issn: 13533452
      maglogo: N
    pubinfo:
      dt: Dec2025
      vid: 31
      iid: 6
      pid: 237
      pub: Springer Nature
    artinfo:
      ui:
        190563989
        10.1007/s11948-025-00567-8
      ppf: 1
      ppct: 26
      formats:
        fmt:
          – @attributes:
              type: T
          – @attributes:
              type: P
              size: 1.1MB
      tig:
        atl: Addressing Autonomy Risks in Generative Chatbots with the Socratic Method.
      aug:
        au:
          Lu, Wencheng
          Hu, Zhenni
        affil: School of Humanities, Southeast University, No.2, SEU Road, Nanjing211189, China
      su:
        Chatbots
        Autonomy (Philosophy)
        Intelligent agents
        Human-artificial intelligence interaction
        Artificial intelligence & ethics
        Dialectic
        Cognitive bias
      sug:
        subj:
          Chatbots
          Autonomy (Philosophy)
          Intelligent agents
          Human-artificial intelligence interaction
          Artificial intelligence & ethics
          Dialectic
          Cognitive bias
      keyword:
        Autonomy
        Chatbot
        Generative AI
        Human agency
        Philosophy and Religious Studies Philosophy
        The Socratic method
      ab: Autonomy is a fundamental ethical principle in artificial intelligence (AI) ethics. Current discussions regarding autonomy-related risks in human–AI interaction, as well as potential mitigation strategies, have mainly focused on recommendation systems and algorithmic decision-making systems. However, systematic analyses of the autonomy issues posed by newly emerging generative AI or chatbots (such as ChatGPT) remain scarce. This paper aims to bridge this gap and proposes a Socratic method-based chatbot, herein designated SocrAI, as a potential countermeasure informed by recent technological advancements. We identify two primary forms of autonomy risk associated with generative chatbots—false mental states and cognitive deskilling—and, through an examination of their underlying causes, argue that the Socratic method offers a plausible means of mitigation. The paper further assesses the feasibility of employing the Socratic method within generative chatbots to preserve and support users’ autonomy and outlines the prospective implementation of SocrAI together with directions for future work. SocrAI represents a novel attempt to strengthen human agency, one that encourages users to become self-initiating inquirers who, with the assistance of AI, actively engage their abilities in the pursuit of answers.
      pubtype: Academic Journal
      doctype: Article
      src: R
    language: English
    refInfo:
    copyright:
      @attributes:
        flag: Y
      custom: Science & Engineering Ethics is a copyright of Springer, 2025. All Rights Reserved.
      item: Science & Engineering Ethics
      holder: Springer Nature
      dt:
        @attributes:
          year: 2025
    holdings:
      @attributes:
        islocal: N