Using Occlusion-Based Saliency Maps to Explain an Artificial Intelligence Tool in Lung Cancer Screening: Agreement Between Radiologists, Labels, and Visual Prompts.

Occlusion-based saliency maps (OBSMs) are one of the approaches for interpreting decision-making process of an artificial intelligence (AI) system. This study explores the agreement among text responses from a cohort of radiologists to describe diagnostically relevant areas on low-dose CT (LDCT) ima...

Descripción completa

Detalles Bibliográficos
Publicado en:Journal of Digital Imaging Vol. 35; no. 5; pp. 1164 - 1176
Autores principales: Gandomkar, Ziba, Khong, Pek Lan, Punch, Amanda, Lewis, Sarah
Formato: diagnostic images pictorial research tables/charts Journal Article
Publicado: Springer Nature Oct2022
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=159758930&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 159758930
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        08971889
        DOQ
      jtl: Journal of Digital Imaging
      issn: 08971889
      maglogo: N
    pubinfo:
      dt: Oct2022
      vid: 35
      iid: 5
      pid: 237
      pub: Springer Nature
      place: New York, New York
    artinfo:
      ui:
        159758930
        156571646
        159758930
        159758930
        10.1007/s10278-022-00631-w
        159758930
      ppf: 1164
      ppct: 12
      formats:
        fmt:
          – @attributes:
              type: T
          – @attributes:
              type: P
      tig:
        atl: Using Occlusion-Based Saliency Maps to Explain an Artificial Intelligence Tool in Lung Cancer Screening: Agreement Between Radiologists, Labels, and Visual Prompts.
      aug:
        au:
          Gandomkar, Ziba
          Khong, Pek Lan
          Punch, Amanda
          Lewis, Sarah
        affil: Discipline of Medical Imaging Science, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia
      sug:
        subj:
          Lung Neoplasms Diagnosis
          Cancer Screening
          Artificial Intelligence
          Radiologists
          Attitude of Health Personnel
          Tomography, X-Ray Computed Methods
          Human
          Descriptive Statistics
          Decision Making
          Vocabulary
      ab: Occlusion-based saliency maps (OBSMs) are one of the approaches for interpreting decision-making process of an artificial intelligence (AI) system. This study explores the agreement among text responses from a cohort of radiologists to describe diagnostically relevant areas on low-dose CT (LDCT) images. It also explores if radiologists' descriptions of cases misclassified by the AI provide a rationale for ruling out the AI's output. The OBSM indicating the importance of different pixels on the final decision made by an AI were generated for 10 benign cases (3 misclassified by the AI tool as malignant) and 10 malignant cases (2 misclassified by the AI tool as benign). Thirty-six radiologists were asked to use radiological vocabulary, typical to reporting LDCT scans, to describe the mapped regions of interest (ROI). The radiologists' annotations were then grouped by using a clustering-based technique. Topics were extracted from the annotations and for each ROI, a percentage of annotations containing each topic were found. Radiologists annotated 17 and 24 unique ROIs on benign and malignant cases, respectively. Agreement on the main label (e.g., "vessel," "nodule") by radiologists was only seen in only in 12% of all areas (5/41 ROI). Topic analyses identified six descriptors which are commonly associated with a lower malignancy likelihood. Eight common topics related to a higher malignancy likelihood were also determined. Occlusion-based saliency maps were used to explain an AI decision-making process to radiologists, who in turn have provided insight into the level of agreement between the AI's decision and radiological lexicon.
      pubtype: Academic Journal
      doctype:
        diagnostic images
        pictorial
        research
        tables/charts
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N