Browse by author
Lookup NU author(s): Dr Lei ShiORCiD
This work is licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0).
© The Author(s) 2024. Despite recent progress, hand gesture recognition, a highly regarded method of human computer interaction, still faces considerable challenges. In this paper, we address the problem of individual user style variation, which can significantly affect system performance. While previous work only supports the manual inclusion of customized hand gestures in the context of very specific application settings, here, an effective, adaptable graphical interface, supporting user-defined hand gestures is introduced. In our system, hand gestures are personalized by training a camera-based hand gesture recognition model for a particular user, using data just from that user. We employ a lightweight Multilayer Perceptron architecture based on contrastive learning, reducing the size of the data needed and the training timeframes compared to previous recognition models that require massive training datasets. Experimental results demonstrate rapid convergence and satisfactory accuracy of the recognition model, while a user study collects and analyses some initial user feedback on the system in deployment.
Author(s): Wang J, Ivrissimtzis I, Li Z, Shi L
Publication type: Article
Publication status: Published
Journal: Universal Access in the Information Society
Year: 2024
Pages: ePub ahead of Print
Online publication date: 02/08/2024
Acceptance date: 26/07/2024
Date deposited: 16/08/2024
ISSN (print): 1615-5289
ISSN (electronic): 1615-5297
Publisher: Springer Nature
URL: https://doi.org/10.1007/s10209-024-01139-6
DOI: 10.1007/s10209-024-01139-6
Altmetrics provided by Altmetric
