Do better search engines really equate to better clinical decisions? If not, why not?
Previous research has found that improved search engine effectiveness—evaluated using a batch‐style approach—does not always translate to significant improvements in user task performance; however, these prior studies focused on simple recall and precision‐based search tasks. We investigated the sam...
| Publicado en: | Journal of the Association for Information Science & Technology Vol. 72; no. 2; pp. 141 - 156 |
|---|---|
| Autores principales: | , , |
| Formato: | algorithm pictorial research tables/charts Journal Article |
| Publicado: |
Wiley-Blackwell
Feb2021
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=148161000&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 148161000 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 23301635 H6JN jtl: Journal of the Association for Information Science & Technology issn: 23301635 maglogo: N pubinfo: dt: Feb2021 vid: 72 iid: 2 pid: 480 pub: Wiley-Blackwell place: Malden, Massachusetts artinfo: ui: 148161000 145790304 148161000 148161000 10.1002/asi.24398 148161000 ppf: 141 ppct: 15 formats: tig: atl: Do better search engines really equate to better clinical decisions? If not, why not? aug: au: Vegt, Anton Zuccon, Guido Koopman, Bevan affil: School of Information Technology and Electrical Engineering, The University of Queensland, St Lucia Queensland,, Australia sug: subj: Web Search Engines Decision Making, Clinical Task Performance and Analysis Human Health Personnel Students, Medical Questionnaires Descriptive Statistics Internet Searching Computer Literacy Health Information Convenience Sample Australia Information Technology Chi Square Test Post Hoc Analysis ab: Previous research has found that improved search engine effectiveness—evaluated using a batch‐style approach—does not always translate to significant improvements in user task performance; however, these prior studies focused on simple recall and precision‐based search tasks. We investigated the same relationship, but for realistic, complex search tasks required in clinical decision making. One hundred and nine clinicians and final year medical students answered 16 clinical questions. Although the search engine did improve answer accuracy by 20 percentage points, there was no significant difference when participants used a more effective, state‐of‐the‐art search engine. We also found that the search engine effectiveness difference, identified in the lab, was diminished by around 70% when the search engines were used with real users. Despite the aid of the search engine, half of the clinical questions were answered incorrectly. We further identified the relative contribution of search engine effectiveness to the overall end task success. We found that the ability to interpret documents correctly was a much more important factor impacting task success. If these findings are representative, information retrieval research may need to reorient its emphasis towards helping users to better understand information, rather than just finding it for them. pubtype: Academic Journal doctype: algorithm pictorial research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|