Where less is more: Limited feedback in formative online multiple‐choice tests improves student self‐regulation.

Background: Formative online multiple‐choice tests are ubiquitous in higher education and potentially powerful learning tools. However, commonly used feedback approaches in online multiple‐choice tests can discourage meaningful engagement and enable strategies, such as trial‐and‐error, that circumve...

Descripción completa

Detalles Bibliográficos
Publicado en:Journal of Computer Assisted Learning Vol. 40; no. 1; pp. 89 - 104
Autores principales: Say, Richard, Visentin, Denis, Saunders, Annette, Atherton, Iain, Carr, Andrea, King, Carolyn
Formato: clinical trial research tables/charts Journal Article
Publicado: Wiley-Blackwell Feb2024
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=174818398&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 174818398
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        02664909
        6M1
      jtl: Journal of Computer Assisted Learning
      issn: 02664909
      maglogo: Y
    pubinfo:
      dt: Feb2024
      vid: 40
      iid: 1
      pid: 480
      pub: Wiley-Blackwell
      place: Malden, Massachusetts
    artinfo:
      ui:
        174818398
        170958970
        174818398
        174818398
        10.1111/jcal.12868
        174818398
      ppf: 89
      ppct: 15
      formats:
      tig:
        atl: Where less is more: Limited feedback in formative online multiple‐choice tests improves student self‐regulation.
      aug:
        au:
          Say, Richard
          Visentin, Denis
          Saunders, Annette
          Atherton, Iain
          Carr, Andrea
          King, Carolyn
        affil: College of Health and Medicine, University of Tasmania, Alexandria New South Wales,, Australia
      sug:
        subj:
          Students, Nursing Psychosocial Factors
          Educational Measurement
          Online Education
          Test Taking
          Feedback
          Self Regulation Evaluation
          Learning Evaluation
          Collaboration
          Information Seeking Behavior Evaluation
          Student Satisfaction Evaluation
          Human
          Male
          Female
          Adult
          Australia
          Quasi-Experimental Studies
          Clinical Trials
          Multimethod Studies
          Focus Groups
          Crossover Design
          Convenience Sample
          Questionnaires
          Semi-Structured Interview
          Content Analysis
          Thematic Analysis
          T-Tests
          Wilcoxon Signed Rank Test
          Descriptive Statistics
          Data Analysis Software
          Motivation
          Cognition
          Adult: 19-44 years
          Male
          Female
      ab: Background: Formative online multiple‐choice tests are ubiquitous in higher education and potentially powerful learning tools. However, commonly used feedback approaches in online multiple‐choice tests can discourage meaningful engagement and enable strategies, such as trial‐and‐error, that circumvent intended learning outcomes. These strategies will not prepare graduates as self‐regulated learners, nor for the complexities of contemporary work settings. Objectives: To investigate whether providing only a score after formative online multiple‐choice test attempts (score‐only feedback) increases the likelihood of students to engage in self‐regulated learning compared with more directive feedback. Measurable outcomes included deeper learning, collaboration, information seeking, and satisfaction. Methods: Data in this mixed methods study were collected from nursing students through surveys, test results, focus groups, and student discussion board contributions. A quasi‐experimental design was used for quantitative data, and qualitative data were analysed thematically against domains of self‐regulated learning. Results and Conclusions: Students receiving score‐only feedback were more cognitively engaged with the content, collaborated constructively, and sought out richer sources of information. However, it was also associated with lower satisfaction. In this study, minimal feedback created states of uncertainty, which resulted in the activation of self‐regulatory actions. Implications for Practice: Providing overly directive feedback for formative online multiple‐choice tests is conducive to surface‐level learning strategies. By minimising feedback and allowing for extended states of uncertainty, students are more likely to regulate their learning through self‐assessment and problem‐solving strategies, all of which are required by graduates to meet the challenges of real‐world work settings. Lay Description: What is already known about this topic: Formative online multiple‐choice tests are widely used in higher education.Feedback is a critical element in the design of effective online multiple‐choice tests.Formative feedback should promote self‐regulated learning.Feedback types used in multiple‐choice tests facilitate strategies not conducive to self‐regulation. What this paper adds: Online multiple‐choice test feedback can influence how students self‐regulate their learning.Less feedback can result in greater self‐evaluation and performance in summative assessment.Less feedback can encourage richer help‐seeking strategies (collaboration and information seeking).However, less feedback can result in student dissatisfaction. Implications for practice and/or policy: Judicious use of feedback is required in the design of online multiple‐choice tests.Educators should consider providing less feedback to promote learner self‐regulation.Satisfaction with online multiple‐choice tests does not necessarily equate to greater learning.
      pubtype: Academic Journal
      doctype:
        clinical trial
        research
        tables/charts
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N