Assessing ChatGPT's Potential in HIV Prevention Communication: A Comprehensive Evaluation of Accuracy, Completeness, and Inclusivity.
With the advancement of artificial intelligence(AI), platforms like ChatGPT have gained traction in different fields, including Medicine. This study aims to evaluate the potential of ChatGPT in addressing questions related to HIV prevention and to assess its accuracy, completeness, and inclusivity....
| Published in: | AIDS & Behavior Vol. 28; no. 8; pp. 2746 - 2755 |
|---|---|
| Main Authors: | , , , , , , , , , , , , , , , , , , , |
| Format: | research tables/charts Journal Article |
| Published: |
Springer Nature
Aug2024
|
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=178677558&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 178677558 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 10907165 G1T jtl: AIDS & Behavior issn: 10907165 maglogo: N pubinfo: dt: Aug2024 vid: 28 iid: 8 pid: 237 pub: Springer Nature place: New York, New York artinfo: ui: 178677558 177670984 178677558 178677558 10.1007/s10461-024-04391-2 178677558 ppf: 2746 ppct: 9 formats: fmt: – @attributes: type: T – @attributes: type: P tig: atl: Assessing ChatGPT's Potential in HIV Prevention Communication: A Comprehensive Evaluation of Accuracy, Completeness, and Inclusivity. aug: au: De Vito, Andrea Colpani, Agnese Moi, Giulia Babudieri, Sergio Calcagno, Andrea Calvino, Valeria Ceccarelli, Manuela Colpani, Gianmaria d'Ettorre, Gabriella Di Biagio, Antonio Farinella, Massimo Falaguasta, Marco Focà, Emanuele Giupponi, Giusi Habed, Adriano José Isenia, Wigbertson Julian Lo Caputo, Sergio Marchetti, Giulia Modesti, Luca Mussini, Cristina affil: https://ror.org/01bnjbv91 Unit of Infectious Diseases, Department of Medicine, Surgery, and Pharmacy, University of Sassari, 07100, Sassari, Italy sug: subj: Artificial Intelligence, Generative HIV Infections Prevention and Control Health Promotion Methods Communication Standards Consumer Health Information Standards Social Inclusion Human Thematic Analysis Risk Taking Behavior HIV Infections Risk Factors Pregnancy Complications, Infectious Prevention and Control Pregnancy Female HIV Infections Diagnosis Health Screening Pre-Exposure Prophylaxis Anti-Retroviral Agents Therapeutic Use Descriptive Statistics HIV Infections Transmission Communities Social Factors Politics Female ab: With the advancement of artificial intelligence(AI), platforms like ChatGPT have gained traction in different fields, including Medicine. This study aims to evaluate the potential of ChatGPT in addressing questions related to HIV prevention and to assess its accuracy, completeness, and inclusivity. A team consisting of 15 physicians, six members from HIV communities, and three experts in gender and queer studies designed an assessment of ChatGPT. Queries were categorized into five thematic groups: general HIV information, behaviors increasing HIV acquisition risk, HIV and pregnancy, HIV testing, and the prophylaxis use. A team of medical doctors was in charge of developing questions to be submitted to ChatGPT. The other members critically assessed the generated responses regarding level of expertise, accuracy, completeness, and inclusivity. The median accuracy score was 5.5 out of 6, with 88.4% of responses achieving a score ≥ 5. Completeness had a median of 3 out of 3, while the median for inclusivity was 2 out of 3. Some thematic groups, like behaviors associated with HIV transmission and prophylaxis, exhibited higher accuracy, indicating variable performance across different topics. Issues of inclusivity were identified, notably the use of outdated terms and a lack of representation for some communities. ChatGPT demonstrates significant potential in providing accurate information on HIV-related topics. However, while responses were often scientifically accurate, they sometimes lacked the socio-political context and inclusivity essential for effective health communication. This underlines the importance of aligning AI-driven platforms with contemporary health communication strategies and ensuring the balance of accuracy and inclusivity. pubtype: Academic Journal doctype: research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|