Publicação
Vision-based gesture recognition system for human-computer interaction
| Resumo: | Hand gesture recognition, being a natural way of human computer interaction, is an area of active research in computer vision and machine learning. This is an area with many different possible applications, giving users a simpler and more natural way to communicate with robots/systems interfaces, without the need for extra devices. So, the primary goal of gesture recognition research is to create systems, which can identify specific human gestures and use them to convey information or for device control. This work intends to study and implement a solution, generic enough, able to interpret user commands, composed of a set of dynamic and static gestures, and use those solutions to build an application able to work in a realtime human-computer interaction systems. The proposed solution is composed of two modules controlled by a FSM (Finite State Machine): a real time hand tracking and feature extraction system, supported by a SVM (Support Vector Machine) model for static hand posture classification and a set of HMMs (Hidden Markov Models) for dynamic single stroke hand gesture recognition. The experimental results showed that the system works very reliably, being able to recognize the set of defined commands in real-time. The SVM model for hand posture classification, trained with the selected hand features, achieved an accuracy of 99,2%. The proposed solution as the advantage of being computationally simple to train and use, and at the same time generic enough, allowing its application in any robot/system command interface. |
|---|---|
| Autores principais: | Trigueiros, Paulo |
| Outros Autores: | Ribeiro, A. Fernando; Reis, L. P. |
| Assunto: | Human-computer interaction Gesture recognition SVM ANN HMM FSM |
| Ano: | 2014 |
| País: | Portugal |
| Tipo de documento: | comunicação em conferência |
| Tipo de acesso: | acesso aberto |
| Instituição associada: | Universidade do Minho |
| Idioma: | inglês |
| Origem: | RepositóriUM - Universidade do Minho |
Registos relacionados
article Vision based referee sign language recognition system for the RoboCup MSL league
por: Trigueiros, Paulo
Publicado em: (2014)
por: Trigueiros, Paulo
Publicado em: (2014)
article Generic system for human-computer gesture interaction: applications on sign language recognition and robotic soccer refereeing
por: Trigueiros, Paulo
Publicado em: (2015)
por: Trigueiros, Paulo
Publicado em: (2015)
groups Speaker-adaptation for hybrid HMM-ANN continuous speech recognition system
por: Neto, João
Publicado em: (2013)
por: Neto, João
Publicado em: (2013)
book Hand gesture recognition system based in computer vision and machine learning
por: Trigueiros, Paulo
Publicado em: (2015)
por: Trigueiros, Paulo
Publicado em: (2015)
article ZatLab gesture recognition framework: machine learning results
por: Baltazar, André
Publicado em: (2016)
por: Baltazar, André
Publicado em: (2016)
article Generic system for human-computer gesture interaction
por: Trigueiros, Paulo
Publicado em: (2014)
por: Trigueiros, Paulo
Publicado em: (2014)
article Higher order feature extraction and selection for robust human gesture recognition using CSI of COTS Wi-Fi devices
por: Ahmed, Hasmath Farhana
Publicado em: (2019)
por: Ahmed, Hasmath Farhana
Publicado em: (2019)
groups Gesture human-computer interface for command and control
por: Dias, J. M. S.
Publicado em: (2006)
por: Dias, J. M. S.
Publicado em: (2006)
article Vision-based portuguese sign language recognition system
por: Trigueiros, Paulo
Publicado em: (2014)
por: Trigueiros, Paulo
Publicado em: (2014)
article Imitate me!—preliminary tests on an upper members gestures recognition system
por: Silva, Vinicius Corrêa Alves
Publicado em: (2017)
por: Silva, Vinicius Corrêa Alves
Publicado em: (2017)
groups Mobile hand gesture recognition system for the Portuguese sign language
por: Ferreira, S.
Publicado em: (2019)
por: Ferreira, S.
Publicado em: (2019)
groups ZatLab: Gesture Recognition Framework for Artistic Performance Interaction – Overview
por: Baltazar, André
Publicado em: (2015)
por: Baltazar, André
Publicado em: (2015)
article Hand gesture recognition for human computer interaction: a comparative study of different image features
por: Trigueiros, Paulo
Publicado em: (2014)
por: Trigueiros, Paulo
Publicado em: (2014)
article Contactless human-computer interaction using a Deep Neural Network Pipeline for real-time video interpretation and classification
por: Sousa, Regina
Publicado em: (2021)
por: Sousa, Regina
Publicado em: (2021)
article A comparison of machine learning algorithms applied to hand gesture recognition
por: Trigueiros, Paulo
Publicado em: (2012)
por: Trigueiros, Paulo
Publicado em: (2012)
school Speech emotion recognition through statistical classification
por: Ferro, Adelino Rafael Mendes
Publicado em: (2017)
por: Ferro, Adelino Rafael Mendes
Publicado em: (2017)
article Spectral multi-normalisation for robust speech recognition
por: Lima, C. S.
Publicado em: (2003)
por: Lima, C. S.
Publicado em: (2003)
article Towards sociable virtual humans : multimodal recognition of human input and behavior
por: Eckes, Christian
Publicado em: (2007)
por: Eckes, Christian
Publicado em: (2007)
article A robust feature extraction for automatic speech recognition in noisy environments
por: Lima, C. S.
Publicado em: (2002)
por: Lima, C. S.
Publicado em: (2002)
article Real-time emotions recognition system
por: Silva, Vinicius Corrêa Alves
Publicado em: (2016)
por: Silva, Vinicius Corrêa Alves
Publicado em: (2016)
groups Developing games with Magic Playground: a gesture-based game engine
por: Dehanov, Juana
Publicado em: (2005)
por: Dehanov, Juana
Publicado em: (2005)
article Hydrogen consumption prediction of a fuel cell based system with a hybrid intelligent approach
por: Montero-Sousa, Juan Aurelio
Publicado em: (2020)
por: Montero-Sousa, Juan Aurelio
Publicado em: (2020)
article Musical control gestures in mobile handheld devices: Design guidelines informed by daily user experience
por: Clément, A.
Publicado em: (2021)
por: Clément, A.
Publicado em: (2021)
article Pitch restoration for robust speech recognition
por: Lima, C. S.
Publicado em: (2003)
por: Lima, C. S.
Publicado em: (2003)
school Leap motion and artificial intelligence for surgical navigation: automatic hand gestures recognition
por: Magalhães, Bruno Miguel Fernandes
Publicado em: (2023)
por: Magalhães, Bruno Miguel Fernandes
Publicado em: (2023)
article Human action recognition using an image-based temporal and spatial representation
por: Silva, Vinicius Corrêa Alves
Publicado em: (2020)
por: Silva, Vinicius Corrêa Alves
Publicado em: (2020)
article Affective computing emotional body gesture recognition: evolution and the cream of the crop
por: Migueis Vaz Martins, Pedro Jorge
Publicado em: (2025)
por: Migueis Vaz Martins, Pedro Jorge
Publicado em: (2025)
article A feasibility cachaca type recognition using computer vision and pattern recognition
por: Rodrigues, Bruno Urbano
Publicado em: (2016)
por: Rodrigues, Bruno Urbano
Publicado em: (2016)
article Printed 3D gesture recognition thermoformed half sphere compatible with In-Mold electronic applications
por: Correia, V.
Publicado em: (2022)
por: Correia, V.
Publicado em: (2022)
school Hand gesture recognition system based in computer vision and machine learning: Applications on human-machine interaction
por: Trigueiros, Paulo José de Albuquerque Cardoso
Publicado em: (2014)
por: Trigueiros, Paulo José de Albuquerque Cardoso
Publicado em: (2014)
school Automotive gestures recognition based on capacitive sensing
por: Leite, Pedro João Silva
Publicado em: (2017)
por: Leite, Pedro João Silva
Publicado em: (2017)
article The Finger-Knuckle-Print recognition using the kernel principal components analysis and the support vector machines
por: Khellat-Kihel, S.
Publicado em: (2016)
por: Khellat-Kihel, S.
Publicado em: (2016)
book Computer vision and machine learning based hand gesture recognition
por: Trigueiros, Paulo
Publicado em: (2015)
por: Trigueiros, Paulo
Publicado em: (2015)
article Stereotyped movement recognition in children with ASD
por: Rodrigues, Jose L.
Publicado em: (2013)
por: Rodrigues, Jose L.
Publicado em: (2013)
groups HASGS: Hybrid augmented system of Gestural Symbiosis Generating Visual Information
por: Portovedo Marques, Henrique
Publicado em: (2017)
por: Portovedo Marques, Henrique
Publicado em: (2017)
groups HASGS: Hybrid augmented system of Gestural Symbiosis Generating Visual Information
por: Portovedo Marques, Henrique
Publicado em: (2017)
por: Portovedo Marques, Henrique
Publicado em: (2017)
book Assessing the applicability of surface EMG to tongue gesture detection
por: Freitas, João
Publicado em: (2014)
por: Freitas, João
Publicado em: (2014)
article A comparative study of different image features for hand gesture machine learning
por: Trigueiros, Paulo
Publicado em: (2013)
por: Trigueiros, Paulo
Publicado em: (2013)
article A wearable and non-wearable approach for gesture recognition: initial results
por: Silva, Vinicius Corrêa Alves
Publicado em: (2017)
por: Silva, Vinicius Corrêa Alves
Publicado em: (2017)
school Portuguese sign language recognition via computer vision and depth sensor
por: Almeida, Rui Nuno de
Publicado em: (2011)
por: Almeida, Rui Nuno de
Publicado em: (2011)
Registos relacionados
-
article Vision based referee sign language recognition system for the RoboCup MSL league
por: Trigueiros, Paulo
Publicado em: (2014) -
article Generic system for human-computer gesture interaction: applications on sign language recognition and robotic soccer refereeing
por: Trigueiros, Paulo
Publicado em: (2015) -
groups Speaker-adaptation for hybrid HMM-ANN continuous speech recognition system
por: Neto, João
Publicado em: (2013) -
book Hand gesture recognition system based in computer vision and machine learning
por: Trigueiros, Paulo
Publicado em: (2015) -
article ZatLab gesture recognition framework: machine learning results
por: Baltazar, André
Publicado em: (2016)