| Sumario: | Background: Comprehensive assessment of skills and performance are necessary to improve the quality of care in nursing education. Various factors pose challenges to accurate assessments, including high student–teacher ratio and observer bias. Objectives: To establish an assessment system based on first‐person video of smart glasses and validate its usability and feasibility. Methods: We used two cameras (smart glasses for first‐person perspective and a web cam) to perform video analysis for skill and performance assessments. Usability tests were conducted using quantitative and qualitative questionnaires for the usefulness and acceptability of the current assessment system. Data from standardised checklists for three clinical nursing skills (intramuscular injection, endotracheal suction, and Levin tube feeding) were used to analyse the inter‐rater reliability in addition to Fleiss' Kappa coefficient analysis. A total of 22 participants (18 students and 4 reviewers) were recruited. They completed the study. Apart from physical discomfort component, the proposed smart glasses‐based first‐person video assessment system achieved good usability scores from both students and reviewers. Results and Conclusions: Fleiss' Kappa values for individual items ranged from 0.450 to 0.808, with an overall average value of 0.592. Results of this study validated the potential of smart glasses‐based assessment system where a set of beneficial mechanisms may meaningfully support the formative learning process. However, issues regarding upgrading the device and need for guidelines for roles of raters and students still remain. Lay Description: What is currently known about this topic?: Accurate and reliable assessments are essential in health education.Efforts were made to seek technological support in such assessments.Previously, fixed or handheld cameras were frequently used for video‐assisted assessments. What does this paper add?: Given the increased interest in technology‐based assessment systems, the current study took efforts to develop strategies to evaluate students' skills and performances effectively.This paper developed a reliable first‐person video‐based skill assessment system and confirmed its reliability and acceptability. Implications for practice/or policy?: Using smart glasses camera, first video based assessment has potential to enhance accuracy of rating in healthcare education.Along with psychological distance, physical discomfort should be thoughtfully considered when adapting new device and technology.
|
|---|