What should we evaluate when we use technology in education?
Background: There is a lack of critical or empirical work interrogating the nature and purpose of evaluating technology use in education. Objectives: In this study, we examine the values underpinning the evaluation of technology use in education through field specialist perceptions. The study also p...
| Publicado en: | Journal of Computer Assisted Learning Vol. 38; no. 3; pp. 743 - 758 |
|---|---|
| Autores principales: | , , , |
| Formato: | research tables/charts Journal Article |
| Publicado: |
Wiley-Blackwell
Jun2022
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=156451510&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 156451510 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 02664909 6M1 jtl: Journal of Computer Assisted Learning issn: 02664909 maglogo: Y pubinfo: dt: Jun2022 vid: 38 iid: 3 pid: 480 pub: Wiley-Blackwell place: Malden, Massachusetts artinfo: ui: 156451510 154812854 156451510 156451510 10.1111/jcal.12645 156451510 ppf: 743 ppct: 15 formats: tig: atl: What should we evaluate when we use technology in education? aug: au: Lai, Jennifer W. M. Bower, Matt De Nobile, John Breyer, Yvonne affil: Macquarie School of Education, Macquarie University, Sydney New South Wales,, Australia sug: subj: Educational Technology Evaluation Reflection Instrument Construction Computer-Assisted Instruction Content Validity Face Validity Surveys Teaching Data Analysis Software Post Hoc Analysis Confidence Intervals Odds Ratio Descriptive Statistics Human Online Education ab: Background: There is a lack of critical or empirical work interrogating the nature and purpose of evaluating technology use in education. Objectives: In this study, we examine the values underpinning the evaluation of technology use in education through field specialist perceptions. The study also poses critical reflections about the rigour of evaluation instruments development in the educational technology field. Method: A total of 48 domain specialists were surveyed to investigate the face and content validity of 39 items under eight constructs, with both qualitative and quantitative data from the survey analysed. Results: There was an alignment between the constructs that the specialists felt were important and the constructs that have typically been the focus of empirical studies, with field specialists indicating high relevance scores for technology (M = 3.24/4), learning outcomes (M = 3.20/4), affective elements (M = 3.19/4), behaviour (M = 3.15/4), presence/community (M = 3.07/4), teaching/pedagogy (M = 3.01/4), design (M = 2.96/4), and institutional environment (M = 2.86/4). Only a minority of other studies were found to perform face and content validity checks and even then only with small samples of respondents (usually n ≤ 5). Implications: Specialists in educational technology research confirm that all eight dimensions are important to consider when evaluating the use of technology in education. Thorough face and content validity processes should be adopted when developing educational technology evaluation instruments. Further work has validated an eight factor 28 item instrument for evaluating the use of technology in education using a large sample of students from a global open learning online course. Lay Description: What is already known about this topic: Comprehensive evaluation of technology use is essential to make decisions on learning technology strategies.There is a lack of critical work interrogating how technology use is evaluated in education.There is a need for developing evaluation instruments in the educational technology field. What this paper adds: An examination of 48 field specialist perceptions of important constructs when evaluating technology use in education.Field specialists agreed that eight constructs identified in empirical studies were relevant to educational technology evaluation.Evidence of limited face and content validation processes based on previous empirical work.A comprehensive 39‐item instrument for evaluating technology use in education. Implications of study findings for practitioners: Adopt a broad range of constructs when evaluating the use of technology in education.Apply face and content validation processes involving a large sample of experts.Consider using the 39‐item instrument to evaluate educational technology use. pubtype: Academic Journal doctype: research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|