Abstract
These days, technology is growing rapidly, and the market has been introduced with lots of fascinating ways to interact with computers. The advancement of deep learning models and hardware technology also enables more applications with fancy features to be built. The importance of hand gesture recognition has increased due to the prevalence of touchless applications. However, developing an efficient recognition system needs to overcome the challenges of hand segmentation, local hand shape representation, global body configuration representation, and a gesture sequence model. This paper proposed an interactive dashboard that could react to hand gestures. This is also an initiative of the Tunku Abdul Rahman University of Management and Technology (TAR UMT) Smart Campus project. Deep learning models were investigated in this research and the optimal model was selected for the dashboard. In addition, 20BN Jester Dataset was used for the dashboard development. To set up a more user-friendly dashboard, the data communication stream between the captured input stream and commands among the devices will also be studied. As to achieve higher responsiveness from the dashboard, evaluation on data communication protocols which were used to pass the input data included in the study.
Keywords: Computer Vision, Human-Computer Interaction (HCI), Gesture Detection, Real-time systems, Feature Extraction
Authors
Wen Lin Yong [1] ; Jun Kit Chaw [2] ; Yiqi Tew [3]
[1][3] Faculty of Computing and Information Technology, Tunku Abdul Rahman University of Management and Technology, Kuala Lumpur, Malaysia
[2] Institude of IR4.0, Universiti Kebangsaan Malaysia, Bangi, Malaysia
[2] chawjk@ukm.edu.my
Cite Me
Plain Text:
W.L.Yong, J.K.Chaw, Y.Tew, "Interactive Dashboard With Visual Sensing and Zero-Shot Learning Capabilities," International Conference on Digital Transformation and Applications (ICDXA) 2021, 2021, pp. 95-103, doi: https://doi.org/10.56453/icdxa.2021.1009.
BibTex:
@INPROCEEDINGS{ICDXA202109,
author={Wen Lin Yong and Jun Kit Chaw and Yiqi Tew},
booktitle={International Conference on Digital Transformation and Applications (ICDXA) 2021},
title={Interactive Dashboard With Visual Sensing and Zero-Shot Learning Capabilities},
year={2021},
volume={},
number={},
pages={95-103},
doi={https://doi.org/10.56453/icdxa.2021.1009}}
