Improving essay peer grading accuracy in massive open online courses using personalized weights from student's engagement and performance.
Most massive open online courses (MOOC) use simple schemes for aggregating peer grades, taking the mean or the median, or compute weights from information other than the instructor's opinion about the students' knowledge. To reduce the difference between the instructor and students' aggregated score...
| Publicado en: | Journal of Computer Assisted Learning Vol. 35; no. 1; pp. 110 - 121 |
|---|---|
| Autores principales: | , , , |
| Formato: | equations & formulas research tables/charts Journal Article |
| Publicado: |
Wiley-Blackwell
Feb2019
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=134200917&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 134200917 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 02664909 6M1 jtl: Journal of Computer Assisted Learning issn: 02664909 maglogo: Y pubinfo: dt: Feb2019 vid: 35 iid: 1 pid: 480 pub: Wiley-Blackwell place: Malden, Massachusetts artinfo: ui: 134200917 134200917 134200917 10.1111/jcal.12316 134200917 ppf: 110 ppct: 11 formats: tig: atl: Improving essay peer grading accuracy in massive open online courses using personalized weights from student's engagement and performance. aug: au: García‐Martínez, Carlos Cerezo, Rebeca Bermúdez, Manuel Romero, Cristóbal affil: Computer Science Department, University of Cordoba, Cordoba Spain sug: subj: Writing MOOC Academic Performance Information Retrieval Peer Review Professional Knowledge Student Attitudes Human Educational Measurement Summated Rating Scaling Male Female Descriptive Statistics Adult Pearson's Correlation Coefficient Teachers Peer Group Adult: 19-44 years Male Female ab: Most massive open online courses (MOOC) use simple schemes for aggregating peer grades, taking the mean or the median, or compute weights from information other than the instructor's opinion about the students' knowledge. To reduce the difference between the instructor and students' aggregated scores, some proposals compute specific weights to aggregate the peer grades. In this work, we analyse the use of students' engagement and performance measures to compute personalized weights and study the validity of the aggregated scores produced by these common functions, mean, and median, together with two others from the information retrieval field, the geometric and harmonic means. To test this procedure, we have analysed data from a MOOC about Philosophy. The course had 1,059 students registered, and 91 participated in a peer review process that consisted in writing an essay and rating three of their peers using a rubric. We compared the aggregation scores obtained using weighted and nonweighted versions of the functions. Our results show that the correlation between the aggregated scores and the instructor's grades can be improved in relation to peer grading, when using the median and weights are computed according to students' performance in chapter tests. Lay Description: What is already known about this topic: Several MOOC platforms introduce peer review to grade their large number of students enrolled.Peer review makes learners evaluate and grade the work of their equals.MOOCs use unweighted aggregation schemes, for example, mean or median, or compute weights from information other than the instructor's opinion about the students' knowledge. What this paper adds: Different weighted aggregation schemes are applied and analysed to reduce the difference with the grades of a potential instructor.We compute weights proportional to students' engagement or learners' marks on questionnaires.Our approach is also compared with a recent approach for aggregating peer scores. Implications for practice and/or policy: Our approach produced marks closer to those of the instructor with regard to the unweighted aggregations and a recent approach.Contrary to other approaches, our proposal does not increase students' workload. pubtype: Academic Journal doctype: equations & formulas research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|