Assessing the Concordance Between LLM-Based ICD-10 Coding and a Drug Database for Antihypertensive Drug Contraindications: A Weighted Inter-Rater Agreement Study...24th International Conference of Informatics, Management and Technology in Healthcare (ICIMTH), July 3-5, 2026, Athens, Greece.
Background. Manual ICD-10 coding of drug contraindications is resource-intensive and difficult to scale. Large language models (LLMs) have shown early promise for clinical information extraction, but their reliability for structured pharmacological coding relative to validated expert databases remai...
| Publicado en: | Studies in Health Technology & Informatics Vol. 338; pp. 539 - 544 |
|---|---|
| Autores principales: | , , |
| Formato: | proceedings research tables/charts Journal Article |
| Publicado: |
Sage Publications Inc.
2026
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=195115677&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 195115677 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 09269630 U1V jtl: Studies in Health Technology & Informatics issn: 09269630 maglogo: N pubinfo: dt: 2026 vid: 338 pid: 344 pub: Sage Publications Inc. place: Thousand Oaks, California artinfo: ui: 195115677 195115677 195115677 10.3233/SHTI260902 195115677 ppf: 539 ppct: 5 formats: tig: atl: Assessing the Concordance Between LLM-Based ICD-10 Coding and a Drug Database for Antihypertensive Drug Contraindications: A Weighted Inter-Rater Agreement Study...24th International Conference of Informatics, Management and Technology in Healthcare (ICIMTH), July 3-5, 2026, Athens, Greece. aug: au: ADROUJI, Samya MOUAZERd, Abdelmalek LAMY, Jean-Baptiste affil: Sorbonne Université, INSERM, Université Sorbonne Paris Nord, LIMICS, Paris France sug: subj: Antihypertensive Agents Contraindications International Classification of Diseases Natural Language Processing Coding Resource Databases, Health Congresses and Conferences Greece Greece Human Reproducibility of Results Clinical Information Systems Descriptive Statistics kappa Statistic Semantics Cardiology Artificial Intelligence, Generative Conceptual Framework Comparative Studies Dose-Response Relationship, Drug ab: Background. Manual ICD-10 coding of drug contraindications is resource-intensive and difficult to scale. Large language models (LLMs) have shown early promise for clinical information extraction, but their reliability for structured pharmacological coding relative to validated expert databases remains unknown. Objective. To assess the concordance between LLM-based automated ICD-10 coding and Thésorimed drug database1 for antihypertensive drug contraindications. Methods. Contraindications were extracted from Summary of Product Characteristics free-text documents for 301 antihypertensive drugs using a retrieval-augmented generation pipeline and aligned against Thésorimed ICD-10 codes. Agreement was assessed using a binary kappa (κ1, entity presence) and a hierarchical weighted kappa (κ2, ICD-10 code concordance) on 5,074 entities. Results. Entity-level agreement was slight (κ1 = -0.30), reflecting structural differences in source coverage. Code-level agreement among matched pairs was substantial (κ2 = 0.70, Po = 0.871), with 76.9% identical codes. Conclusion. When both sources identify the same contraindication, LLM-based coding shows substantial concordance with expert-curated ICD-10 assignments. However, low entity-level agreement highlights important differences in coverage and representation between sources. pubtype: Academic Journal doctype: proceedings research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|