Comparative evaluation of the reliability and validity of three data extraction programs: UnGraph, GraphClick, and DigitizeIt.
The use of evidence-based practices in education has been gaining a lot of attention in recent years. Researchers often use meta-analyses to identify evidence-based practices. To conduct meta-analyses of studies employing single-subject experimental research (SSER) designs for the purpose of identif...
| Published in: | Computers in Human Behavior Vol. 55; pp. 159 - 167 |
|---|---|
| Main Authors: | , , , |
| Format: | Article |
| Published: |
Elsevier B.V.
Feb2016 Part A
|
| Subjects: | |
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=111011652&site=ehost-live header: @attributes: shortDbName: ssf uiTerm: 111011652 longDbName: Social Sciences Full Text (H.W. Wilson) uiTag: AN controlInfo: bkinfo: jinfo: jid: 07475632 JC4 jtl: Computers in Human Behavior issn: 07475632 maglogo: N pubinfo: dt: Feb2016 Part A vid: 55 pid: 2410 pub: Elsevier B.V. artinfo: ui: 111011652 10.1016/j.chb.2015.09.008 ppf: 159 ppct: 8 formats: tig: atl: Comparative evaluation of the reliability and validity of three data extraction programs: UnGraph, GraphClick, and DigitizeIt. aug: au: Rakap, Salih Rakap, Serife Evran, Derya Cig, Oguzcan affil: Department of Special Education, College of Education, Ondokuz Mayis University, Samsun, Turkey Dumlupinar Primary School, Carsamba, Samsun, Turkey Quantitative Social Science, Institute of Education, University College London, UK Department of Early Childhood Education, College of Education, Florida State University, Tallahassee, FL, 32306, USA su: Commercial product evaluation Comparative studies Computer software Meta-analysis Research evaluation Medical coding sug: subj: Commodity Contracts Dealing Commodity Contracts Brokerage Computer and software stores Software publishers (except video game publishers) Computer and Computer Peripheral Equipment and Software Merchant Wholesalers Computer, computer peripheral and pre-packaged software merchant wholesalers Commercial product evaluation Comparative studies Computer software Meta-analysis Research evaluation Medical coding keyword: Data extraction programs DigitizeIt GraphClick Reliability and validity Single-subject experimental research designs UnGraph Data extraction programs DigitizeIt GraphClick Reliability and validity Single-subject experimental research designs UnGraph ab: The use of evidence-based practices in education has been gaining a lot of attention in recent years. Researchers often use meta-analyses to identify evidence-based practices. To conduct meta-analyses of studies employing single-subject experimental research (SSER) designs for the purpose of identifying evidence base for a practice, a necessary step is to obtain raw data from published graphs. One method for obtaining raw data from published SSER graphs is the use of computer programs specifically designed to extract data from graphs. Purpose of the present study was to examine the reliability and validity of three data extraction programs, Ungraph, GraphClick, and DigitizeIt, using 60 graphs obtained from 15 SSER studies focused on a practice. Three coders extracted data from the graphs using the three programs. Values extracted by each coder were compared to (a) each other (reliability) and (b) values reported in the original articles in which the graphs were obtained from (validity). Results showed that raw data from SSER graphs can be obtained reliably using all three data extraction programs and values obtained using the three programs are highly valid. These results suggest that researchers can use data extracted using these programs with a high level of confidences while conducting meta-analyses of studies employing SSER designs. Authors make recommendations for improving the accuracy of data extraction using the three programs. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: N holdings: @attributes: islocal: N |
|---|