Development and validation of a test for measuring primary school students' effective use of ICT: The ECC‐ICT test.
Background: A practical test that measures the information and communication technology (ICT) skills students need for effectively using ICT in primary education has yet to be developed (Oh et al., 2021). This paper reports on the development, validation, and reliability of a test measuring primary...
| Publicado en: | Journal of Computer Assisted Learning Vol. 40; no. 3; pp. 960 - 973 |
|---|---|
| Autores principales: | , , , , , |
| Formato: | pictorial research tables/charts Journal Article |
| Publicado: |
Wiley-Blackwell
Jun2024
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=177193459&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 177193459 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 02664909 6M1 jtl: Journal of Computer Assisted Learning issn: 02664909 maglogo: Y pubinfo: dt: Jun2024 vid: 40 iid: 3 pid: 480 pub: Wiley-Blackwell place: Malden, Massachusetts artinfo: ui: 177193459 174404911 177193459 177193459 10.1111/jcal.12924 177193459 ppf: 960 ppct: 13 formats: tig: atl: Development and validation of a test for measuring primary school students' effective use of ICT: The ECC‐ICT test. aug: au: Ackermans, Kevin Bakker, Marjoke Gorissen, Pierre van Loon, Anne‐Marieke Kral, Marijke Camp, Gino affil: Department of Educational Science, Open University of the Netherlands, Heerlen, The Netherlands sug: subj: Information Technology Information Literacy Evaluation Communication Skills Evaluation Students, Elementary Competency Assessment Aptitude Tests Test Construction Human Validation Studies Computer Literacy Multimethod Studies Pilot Studies Interviews Cognition Factor Analysis Analysis of Variance Collaboration Criterion-Related Validity Internal Consistency Discriminant Validity Post Hoc Analysis Instrument Construction Instrument Validation Academic Achievement Funding Source ab: Background: A practical test that measures the information and communication technology (ICT) skills students need for effectively using ICT in primary education has yet to be developed (Oh et al., 2021). This paper reports on the development, validation, and reliability of a test measuring primary school students' ICT skills required for effectively using ICT (the ECC‐ICT test). Objectives: Based on existing literature, three ICT use domains were identified for effectively using ICT: Effective, collaborative, and creativeuse of ICT. For these three domains, 24 corresponding teaching objectives were identified from a widely used digital literacy framework. Thirty‐four test items cover these teaching objectives in an online test. Methods: A mixed‐method approach was used for the ECC‐ICT test. Four pilot rounds (n=25) implemented qualitative interviews for cognitive validity and refining the test items, followed by a qualitative usability study(n=6). Confirmatory factor analysis and ANOVA provided quantitative insight into the large‐scale test administration(n=575). Results and Conclusions: Composite reliability of our conceptual 3‐factor confirmatory model showed that the test reliably measured primary school effective use of ICT (ω = 0.82), collaborative use of ICT (ω = 0.80) and creative use of ICT (ω = 0.64). Convergent validity (ranging from 0.41 to 0.46) was acceptable. Internal consistency (ranging from 0.84 to 0.91) and discriminant validity (HTMT values below 0.90) are good. ANOVA results show that mean test scores are higher for students in higher grade levels (p < 0.001). The post hoc Bonferroni results show that most grade‐by‐grade comparisons are significant (p < 0.001). Lay Description: What is already known about this topic: Information and communication technology (ICT) skills are finding their way into national curriculums as teachers implement more digital learning environments.Teachers currently do not have a measurement instrument for the ICT skills primary education students need to learn in a personalised way. What this paper adds: This paper gives teachers a test that reliably measures the effective, collaborative, and creative ICT skills required for primary school students to learn using ICT.To our knowledge, this test is the first of its kind.Al materials to reproduce the test are available digitally for teachers. The implications of study findings for practitioners: For policy, this test can be used to check if a student is ready to use ICT in a self‐regulated setting.With this test, teachers can assess and support students' growth on the effective, collaborative, and creative ICT skills required for primary school students using ICT. pubtype: Academic Journal doctype: pictorial research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|