Unveiling Patterns of Interaction With Automated Feedback in Writing Mentor and Their Relationships With Use Goals and Writing Outcomes.

Background: Writing is integral to educational success at all levels and to success in the workplace. However, low literacy is a global challenge, and many students lack sufficient skills to be good writers. With the rapid advance of technology, computer‐based tools that provide automated feedback a...

Full description

Bibliographic Details
Published in:Journal of Computer Assisted Learning Vol. 41; no. 2; pp. 1 - 16
Main Authors: Jiang, Yang, Klebanov, Beata Beigman, Hao, Jiangang, Deane, Paul, Livne, Oren E.
Format: pictorial research tables/charts Journal Article
Published: Wiley-Blackwell Apr2025
Online Access:View this record in EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=184016312&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 184016312
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        02664909
        6M1
      jtl: Journal of Computer Assisted Learning
      issn: 02664909
      maglogo: Y
    pubinfo:
      dt: Apr2025
      vid: 41
      iid: 2
      pid: 480
      pub: Wiley-Blackwell
      place: Malden, Massachusetts
    artinfo:
      ui:
        184016312
        184016312
        184016312
        10.1111/jcal.70014
        184016312
      ppf: 1
      ppct: 15
      formats:
      tig:
        atl: Unveiling Patterns of Interaction With Automated Feedback in Writing Mentor and Their Relationships With Use Goals and Writing Outcomes.
      aug:
        au:
          Jiang, Yang
          Klebanov, Beata Beigman
          Hao, Jiangang
          Deane, Paul
          Livne, Oren E.
        affil: ETS Research Institute, Princeton New Jersey, , USA
      sug:
        subj:
          Feedback
          Mentorship
          Writing
          Automation
          Computer-Assisted Instruction
          Goals and Objectives
          Natural Language Processing
          World Wide Web Applications
          Quality Improvement
          Human
          Funding Source
          Academic Achievement
          Success
          Literacy
          Students Psychosocial Factors
          Students, Middle School
          Students, High School
          Student Attitudes
          Data Mining
          Support, Psychosocial
          Conceptual Framework
          Documentation
          Edit and Review
          Survey Research
          Grammar
          Spelling
          Interrater Reliability
          Algorithms
          Linear Regression
          Pearson's Correlation Coefficient
          Time Factors
          Kruskal-Wallis Test
          Wilcoxon Signed Rank Test
          Mann-Whitney U Test
          User-Computer Interface
          Logistic Regression
          Human Error Prevention and Control
          Descriptive Statistics
          Chi Square Test
      ab: Background: Writing is integral to educational success at all levels and to success in the workplace. However, low literacy is a global challenge, and many students lack sufficient skills to be good writers. With the rapid advance of technology, computer‐based tools that provide automated feedback are being increasingly developed. However, mixed results have been obtained so far on the effects of writing feedback, and little is known about how various types of feedback are used by users who access feedback with different goals. Objectives: Leveraging both process and response data, the present study investigated students' interactions with feedback in Writing Mentor (WM), an app designed to support academic writing through automated feedback and NLP techniques. Methods: We identified 1857 documents submitted by middle‐ and high‐school students among users‐in‐the‐wild and explored the activities that students engaged in while using WM and the quality of their submitted written products. Students' interaction processes and behaviours were compared across groups of students with different goals for using WM. In addition, sequential pattern mining was applied to identify interesting sequential patterns of student interactions with the writing feedback features that are differentially frequent across goal groups. Results and Conclusions: Results indicated that students with different goals for using WM displayed different patterns of interaction. Furthermore, the effects of the various types of feedback on writing quality vary by students' purposes for using the tool. Findings from this study shed light on the design of computer‐based writing tools and automated writing feedback for learners of various needs.
      pubtype: Academic Journal
      doctype:
        pictorial
        research
        tables/charts
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N