Sign Language Learning System with Concurrent Shared Avatar Hand in a Virtual Environment: Psychological Evaluation
Loading...
Date
2022
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
We aimed to develop a sign language learning system using virtual reality to improve learning motivation. Hand movements for twenty words consisted of three letters were recorded with a hand motion capture system (model hand). In the learning system, the participant was asked to mimic the model hand movement while looking at both the model hand and the ''own hand'' in a head mounted display (HMD) with the hand motion capture. The ''own hand'' avatar was either of the real own hand or the shared hand motion, which was made by averaging the participant's hand and the model hand movements. The model hand was presented either in the opposite or same direction as the participant. Participants rated the usability of the system in 2 x 2 (own/shared hand x opposite/same direction) experimental blocked design. We found that the shared hand avatar and the same direction presentation were better than the own hand and the opposite direction presentation, respectively. Thus, the proposed shared hand avatar system with the HMD and hand motion capture could improve sign language learning.
Description
CCS Concepts: Human-centered computing -> Virtual reality; Applied computing -> Computer-assisted instruction
@inproceedings{10.2312:egve.20221300,
booktitle = {ICAT-EGVE 2022 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments - Posters and Demos},
editor = {Theophilus Teo and Ryota Kondo},
title = {{Sign Language Learning System with Concurrent Shared Avatar Hand in a Virtual Environment: Psychological Evaluation}},
author = {Katsumata, Yasunobu and Ishimoto, Hiroki and Inoue, Yasuyuki and Kitazaki, Michiteru},
year = {2022},
publisher = {The Eurographics Association},
ISSN = {1727-530X},
ISBN = {978-3-03868-192-2},
DOI = {10.2312/egve.20221300}
}