Digitalizing Medical Forms Through Visual Question Answering: Are We There Yet?...20th World Congress on Medical and Health Informatics, Aug 09 - 13, 2025, Taipei, Taiwan.

This study investigates the potential of multimodal neural networks to convert data from unstructured paper-based medical documents into a structured format. Utilizing advancements in Visual Question Answering, we curated a dataset from neurological documents at the University Medical Center Hamburg...

Descripción completa

Detalles Bibliográficos
Publicado en:Studies in Health Technology & Informatics Vol. 329; pp. 253 - 258
Autores principales: GUNDLER, Christopher, WIEDERHOLD, Alexander Johannes, PÖTTER-NERGER, Monika
Formato: proceedings research tables/charts Journal Article
Publicado: Sage Publications Inc. 2025
Acceso en línea:Ver este registro en EBSCOhost
Descripción
Sumario:This study investigates the potential of multimodal neural networks to convert data from unstructured paper-based medical documents into a structured format. Utilizing advancements in Visual Question Answering, we curated a dataset from neurological documents at the University Medical Center Hamburg-Eppendorf. Different models were assessed for their effectiveness. While models from 2024 showed improved performance, accuracy remained below clinical standards, revealing significant challenges in adapting such technology to complex and heterogeneous medical records. The findings emphasize the need for larger, diverse datasets and ongoing refinement to bridge the gap between current model capabilities and human-level performance, underscoring the complexity of automating data extraction in clinical settings.