Assessing the Quality of Biomedical Boolean Search Strings Generated by Prompted and Unprompted Models Using ChatGPT: A Pilot Study.

This pilot study investigated the use of Generative AI using ChatGPT to produce Boolean search strings to query PubMed. The goals were to determine if ChatGPT could be used in search string formation and if so, which approach was most effective. Research outputs from published systematic reviews wer...

Descripción completa

Detalles Bibliográficos
Publicado en:Medical Reference Services Quarterly Vol. 44; no. 1; pp. 31 - 41
Autores principales: Reed, Robyn B., Barnett, Derek J.
Formato: research tables/charts Journal Article
Publicado: Taylor & Francis Ltd Jan-Mar2025
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=184297862&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 184297862
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        02763869
        4DM
      jtl: Medical Reference Services Quarterly
      issn: 02763869
      maglogo: N
    pubinfo:
      dt: Jan-Mar2025
      vid: 44
      iid: 1
      pid: 377
      pub: Taylor & Francis Ltd
      place: Philadelphia, Pennsylvania
    artinfo:
      ui:
        184297862
        183181475
        184297862
        184297862
        10.1080/02763869.2024.2440848
        184297862
      ppf: 31
      ppct: 10
      formats:
      tig:
        atl: Assessing the Quality of Biomedical Boolean Search Strings Generated by Prompted and Unprompted Models Using ChatGPT: A Pilot Study.
      aug:
        au:
          Reed, Robyn B.
          Barnett, Derek J.
        affil: Harrell Health Sciences Library, Penn State College of Medicine, Biomedical Informatics and Emerging Technologies Librarian, 500 University Dr, Hershey, PA, USA
      sug:
        subj:
          Artificial Intelligence, Generative Utilization
          Literature Searching
          PubMed
          Quality Assessment
          Sensitivity and Specificity
          Prediction Models
          Human
          Pilot Studies
          Systematic Review
          Information Retrieval
          Descriptive Statistics
      ab: This pilot study investigated the use of Generative AI using ChatGPT to produce Boolean search strings to query PubMed. The goals were to determine if ChatGPT could be used in search string formation and if so, which approach was most effective. Research outputs from published systematic reviews were compared to outputs from AI generated search strings. While moderate overlap in publication retrieval between published and AI generated search strings was noted, the numbers were not sufficient to completely replicate published search strings and little difference was observed between prompted and unprompted GPT in using ChatGPT.
      pubtype: Academic Journal
      doctype:
        research
        tables/charts
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N