Exploring the Effectiveness of Large‐Scale Automated Writing Evaluation Implementation on State Test Performance Using Generalised Boosted Modelling.
Background: Automated writing evaluation (AWE) systems, used as formative assessment tools in writing classrooms, are promising for enhancing instruction and improving student performance. Although meta‐analytic evidence supports AWE's effectiveness in various contexts, research on its effectiveness...
| Publicado en: | Journal of Computer Assisted Learning Vol. 41; no. 2; pp. 1 - 25 |
|---|---|
| Autores principales: | , |
| Formato: | research tables/charts Journal Article |
| Publicado: |
Wiley-Blackwell
Apr2025
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=184016307&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 184016307 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 02664909 6M1 jtl: Journal of Computer Assisted Learning issn: 02664909 maglogo: Y pubinfo: dt: Apr2025 vid: 41 iid: 2 pid: 480 pub: Wiley-Blackwell place: Malden, Massachusetts artinfo: ui: 184016307 184016307 184016307 10.1111/jcal.70009 184016307 ppf: 1 ppct: 24 formats: tig: atl: Exploring the Effectiveness of Large‐Scale Automated Writing Evaluation Implementation on State Test Performance Using Generalised Boosted Modelling. aug: au: Huang, Yue Wilson, Joshua affil: Measurement Incorporated, Durham, USA sug: subj: Academic Performance Evaluation Writing Evaluation Automation English Language Language Arts Program Implementation Schools, Elementary Schools, Middle Schools, Secondary Models, Educational Outcomes of Education Human Funding Source Utah Male Female Quasi-Experimental Studies Exploratory Research Qualitative Studies Comparative Studies Conceptual Framework Descriptive Statistics Learning Environment Learning Methods Male Female ab: Background: Automated writing evaluation (AWE) systems, used as formative assessment tools in writing classrooms, are promising for enhancing instruction and improving student performance. Although meta‐analytic evidence supports AWE's effectiveness in various contexts, research on its effectiveness in the U.S. K–12 setting has lagged behind its rapid adoption. Further rigorous studies are needed to investigate the effectiveness of AWE within the U.S. K–12 context. Objectives: This study aims to investigate the usage and effectiveness of the Utah Compose AWE system on students' state test English Language Arts (ELA) performance in its first year of statewide implementation. Methods: The sample included all students from grades 4–11 during the school year 2015 in Utah (N = 337,473). Employing a quasi‐experimental design using generalised boosted modelling for propensity score weighting, the analysis focused on estimating the average treatment effects among the treated (ATT) of the AWE system. Results and Conclusions: The results showed that students who utilised AWE more frequently demonstrated improved ELA performance compared to their counterparts with lower or no usage. The effects varied across certain student demographic groups. This study provides strong and systematic evidence to support the hypothesis of causal inferences regarding AWE's effects within a large‐scale, naturalistic implementation, offering valuable insights for stakeholders seeking to understand the effectiveness of AWE systems. pubtype: Academic Journal doctype: research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|