Spoken conversational search: Evaluating the effect of system clarifications on user experience through Wizard‐of‐Oz study.

Prior research in human–computer interaction suggests that system‐level clarifications are necessary for understanding user intent and communicating effectively with the user. Such clarifications or explanations could contain the system's abstract knowledge of the search or a functional description...

Descripción completa

Detalles Bibliográficos
Publicado en:Journal of the Association for Information Science & Technology Vol. 76; no. 5; pp. 819 - 840
Autores principales: Ghosh, Souvick, Shah, Chirag
Formato: questionnaire/scale research tables/charts Journal Article
Publicado: Wiley-Blackwell May2025
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=184338873&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 184338873
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        23301635
        H6JN
      jtl: Journal of the Association for Information Science & Technology
      issn: 23301635
      maglogo: N
    pubinfo:
      dt: May2025
      vid: 76
      iid: 5
      pid: 480
      pub: Wiley-Blackwell
      place: Malden, Massachusetts
    artinfo:
      ui:
        184338873
        181908061
        184338873
        184338873
        10.1002/asi.24974
        184338873
      ppf: 819
      ppct: 21
      formats:
      tig:
        atl: Spoken conversational search: Evaluating the effect of system clarifications on user experience through Wizard‐of‐Oz study.
      aug:
        au:
          Ghosh, Souvick
          Shah, Chirag
        affil: School of Information, San José State University, San José California,, USA
      sug:
        subj:
          Voice Recognition Systems
          User-Computer Interface
          Consumer Satisfaction
          Speech Perception
          Conversation
          Task Performance and Analysis
          Human
          Adult
          Male
          Female
          Data Analysis, Statistical
          Quantitative Studies
          Wilcoxon Signed Rank Test
          Descriptive Statistics
          Information Seeking Behavior
          Artificial Intelligence
          Computer Literacy
          Students, College
          Information Retrieval
          Age Factors
          Sex Factors
          Educational Status
          Memory
          Adult: 19-44 years
          Male
          Female
      ab: Prior research in human–computer interaction suggests that system‐level clarifications are necessary for understanding user intent and communicating effectively with the user. Such clarifications or explanations could contain the system's abstract knowledge of the search or a functional description of the search process (queries and information sources employed). While these interactions may aid the user and the agent in better understanding each other, very few studies have explored the influence of such clarifications on the users' search experience. This research examines whether and how system‐level clarifications (or explanations) affect the user experience when searching through spoken dialogues. We analyzed user satisfaction and preferences in systems with and without explicit clarifications in a within‐subjects Wizard‐of‐Oz user study. We recruited 25 participants and collected user–system interaction data for 50 search sessions. The user feedback was collected using pre‐ and post‐task surveys and exit interviews. Statistical and qualitative analysis of user responses yielded some interesting findings. While Wilcoxon Signed Rank Test found that using explicit system‐level clarifications had no positive influence on the user's search experience, the overall search experience degraded with system clarifications (Z = −2.066, p = 0.04). The user interview data provided valuable insights into how and when clarifications should be offered to the user.
      pubtype: Academic Journal
      doctype:
        questionnaire/scale
        research
        tables/charts
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N