Real-time human–computer interface based on eye gaze estimation from low-quality webcam images: integration of convolutional neural networks, calibration, and transfer learning.
Eye gaze estimation represents a well-established research domain within computer vision. It has a wide range of practical applications in numerous fields, including human–computer interaction (HCI) for cursor control, health care, and virtual reality, enhancing its suitability for adoption througho...
| Publicado en: | Digital Scholarship in the Humanities Vol. 40; no. 1; pp. 64 - 75 |
|---|---|
| Autores principales: | , , , |
| Formato: | Artículo |
| Publicado: |
Oxford University Press / USA
Apr2025
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=184296835&site=ehost-live header: @attributes: shortDbName: hlh uiTerm: 184296835 longDbName: Humanities International Complete uiTag: AN controlInfo: bkinfo: jinfo: jid: 2055768X JEO9 jtl: Digital Scholarship in the Humanities issn: 2055768X maglogo: N pubinfo: dt: Apr2025 vid: 40 iid: 1 pid: 622 pub: Oxford University Press / USA artinfo: ui: 184296835 10.1093/llc/fqae088 ppf: 64 ppct: 11 formats: fmt: – @attributes: type: T – @attributes: type: P size: 1.4MB tig: atl: Real-time human–computer interface based on eye gaze estimation from low-quality webcam images: integration of convolutional neural networks, calibration, and transfer learning. aug: au: Chhimpa, Govind R Kumar, Ajay Garhwal, Sunita Kumar, Dhiraj affil: Computer Science and Engineering Department, Thapar Institute of Engineering and Technology, Patiala, 147001, Punjab, India Department of Internet of Things and Intelligent Systems, Manipal University Jaipur, Jaipur, 303007, Rajasthan, India CSIR-Central Electronics Engineering Research Institute, Pilani, 333031, Rajasthan, India su: Convolutional neural networks Computer vision Eye tracking Geometric modeling Webcams Virtual reality sug: subj: Convolutional neural networks Computer vision Eye tracking Geometric modeling Webcams Virtual reality keyword: calibration CNN eye gaze human–computer interaction transfer learning ab: Eye gaze estimation represents a well-established research domain within computer vision. It has a wide range of practical applications in numerous fields, including human–computer interaction (HCI) for cursor control, health care, and virtual reality, enhancing its suitability for adoption throughout the scientific community. Different methods have been used for eye gaze estimation, such as model based, feature based, and appearance based. The appearance-based method is mainly used because it directly estimates an individual's gaze direction from images/videos rather than depending on specific features or geometric models. This article developed an appearance-based, real-time generic eye gaze system for HCI to control the cursor through the eye using the convolutional neural network (CNN), calibration, and transfer learning. The study employed low-quality eye images captured from a conventional desktop webcam, enabling the proposed methodology to be implemented on any computer system equipped with a similar web camera without the need for supplementary hardware. Initially, the labeled dataset of both eyes is collected using the webcam. Then, a CNN model is trained by inputting left and right eye images to predict the gaze coordinate as output. We applied the calibration and transfer learning approach to the trained models to make a generic model for new users. In real-time use, the first step is calibration, where the user's eye images are captured for various screen coordinates, and transfer learning is employed to fine-tune the pre-trained model according to the user's eyes. Then, the fine-tuned model is used for eye gaze prediction to control the cursor. The system's performance is evaluated using a test group of multiple users, and it demonstrated an average visual angle accuracy of 2.08 degrees before calibration, which notably improved to 1.81 degrees after the calibration process. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: Y custom: © 2019 EADH: The European Association for Digital Humanities. item: Digital Scholarship in the Humanities holder: Oxford University Press / USA dt: @attributes: year: 2025 holdings: @attributes: islocal: N |
|---|