AR-Eye: A Custom, Low-Cost Eye Tracker for Mental Fatigue Detection with Pattern-Based Machine Learning on Augmented Reality Headsets
Loading...
Date
2025
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
We present a low-cost, custom-built eye tracking system designed as a modular add-on for augmented reality (AR) headsets that either lack native eye tracking capabilities or provide insufficient ocular data for cognitive monitoring. Our system leverages infrared-enabled cameras and machine learning techniques to extract oculometric features-pupil diameter, blink dynamics, and saccadic velocity-in real time, enabling reliable detection of user mental fatigue. Unlike commercial high-cost solutions or restricted APIs of built-in AR trackers, the proposed device provides direct access to raw eye metrics under diverse conditions. We implement an unsupervised clustering approach combined with supervised classifiers to estimate fatigue levels on a persecond basis, integrating both self-reports and objective eye tracking data. Results are streamed into the AR environment, where individual and team-wide fatigue states are visualized through intuitive holographic overlays. This collaborative monitoring framework enables users to track both their own and others' cognitive states, supporting adaptive interventions in shared AR tasks. The system demonstrates the feasibility of affordable, portable, and extensible ocular-based fatigue detection for enhancing performance, safety, and well-being in group-oriented AR applications.
Description
CCS Concepts: Human-centered computing → Mixed / augmented reality; Collaborative interaction; Hardware → Sensor devices and platforms; Computer systems organization → Real-time systems; Computing methodologies → Machine learning; Computer vision
@inproceedings{10.2312:egve.20251350,
booktitle = {ICAT-EGVE 2025 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments},
editor = {Jorge, Joaquim A. and Sakata, Nobuchika},
title = {{AR-Eye: A Custom, Low-Cost Eye Tracker for Mental Fatigue Detection with Pattern-Based Machine Learning on Augmented Reality Headsets}},
author = {Stavroulakis, Alexios and Roumeliotis, Michail and Safranoglou, Ioannis and Ramiotis, George and Mania, Katerina},
year = {2025},
publisher = {The Eurographics Association},
ISSN = {1727-530X},
ISBN = {978-3-03868-278-3},
DOI = {10.2312/egve.20251350}
}