Publicação
Interfaces gestuais baseados no controlador Leap Motion
| Resumo: | In the present, most of the human-machine interactions are based on the use of peripherals such as keyboard and computer mouse. However, the use of such peripherals can create certain limitations in the way people interact with machines, for this reason, there is a need to create natural interfaces. One of the possible approaches that has been proposed involves performing gestures that are recognized by a sensor and interpreted by the computer. The use of hands on a human-machine interface is justified by the fact that the hands are an important element in nonverbal communications. Due to this, in this project several possible gesture interfaces were analyzed, using the Leap Motion sensor. The project was based on the development of methods that allowed the recognition of gestures and their association to an action that the computer should perform. Through the analysis of existing studies in the area and the various methods used to allow a program to classify a data set, a gesture classification system was developed. The classification system has tested to verify its accuracy and precision. Using the knowledge obtained throughout the project, and as proof of concept, an application was developed to demonstrate the usefulness of the classification system in a real situation. This application can recognize a gesture and associate it with a keyboard key, allowing a user to write the message resulting from the gestures he makes. This project main conclusion was that the gesture classification system trained using SVM can make a good separation of the various gestures and with this classify correctly the gestures. Most of problems that arise during the recognition of a gesture are a consequence of the Leap Motion not being able to track correctly the gesture being made. |
|---|---|
| Autores principais: | Bizarro, João Pedro Pereira |
| Assunto: | Leap motion Hand gesture Gesture interfaces Gesture classification Classification system Motion sensor |
| Ano: | 2019 |
| País: | Portugal |
| Tipo de documento: | dissertação de mestrado |
| Tipo de acesso: | acesso aberto |
| Instituição associada: | Instituto Politécnico de Coimbra |
| Idioma: | português |
| Origem: | Instituto Politécnico de Coimbra |
Registos relacionados
groups Hand gestures recognition for an intelligent wheelchair steering command
por: Almeida, Patrícia
Publicado em: (2023)
por: Almeida, Patrícia
Publicado em: (2023)
groups Separating gesture detection and application control concerns with a multimodal architecture
por: Morgado, Leonel
Publicado em: (2015)
por: Morgado, Leonel
Publicado em: (2015)
school Natural User Interfaces
por: Ferreira, Sara João Cardoso
Publicado em: (2014)
por: Ferreira, Sara João Cardoso
Publicado em: (2014)
article Hand/arm Gesture Segmentation by Motion Using IMU and EMG Sensing
por: Lopes, João
Publicado em: (2017)
por: Lopes, João
Publicado em: (2017)
article Sign language learning using the hangman videogame
por: Soares, Filomena
Publicado em: (2016)
por: Soares, Filomena
Publicado em: (2016)
groups A game as a tool for empirical research on the shamanic interface concept
por: Pinto, Tiago Susano
Publicado em: (2015)
por: Pinto, Tiago Susano
Publicado em: (2015)
article Vision-based portuguese sign language recognition system
por: Trigueiros, Paulo
Publicado em: (2014)
por: Trigueiros, Paulo
Publicado em: (2014)
article Measuring Aksak Rhythm and Synchronization in Transylvanian Village Music by Using Motion Capture
por: Baraldi, Filippo Bonini
Publicado em: (2015)
por: Baraldi, Filippo Bonini
Publicado em: (2015)
school Using distributed accelerometers for gesture recognition and visualization
por: Trindade, Pedro Emanuel dos Santos Vale Sousa
Publicado em: (2010)
por: Trindade, Pedro Emanuel dos Santos Vale Sousa
Publicado em: (2010)
groups Wrist and hand rehabilitation software platform based on leap motion controller
por: Postolache, G.
Publicado em: (2017)
por: Postolache, G.
Publicado em: (2017)
school Leap motion and artificial intelligence for surgical navigation: automatic hand gestures recognition
por: Magalhães, Bruno Miguel Fernandes
Publicado em: (2023)
por: Magalhães, Bruno Miguel Fernandes
Publicado em: (2023)
groups Qualitative perspectives on gesture in saxophone performance: two case studies
por: Moura, Nádia
Publicado em: (2020)
por: Moura, Nádia
Publicado em: (2020)
groups Shamanic interfaces for computers and gaming platforms
por: Carvalho, Filipe
Publicado em: (2014)
por: Carvalho, Filipe
Publicado em: (2014)
school Aplicação do Leap Motion na avaliação da doença de Parkinson
por: Oliveira, Mariana Ferreira Alves de
Publicado em: (2019)
por: Oliveira, Mariana Ferreira Alves de
Publicado em: (2019)
groups Conceiving involuntary movements as musical performance tools
por: Portovedo, Henrique
Publicado em: (2016)
por: Portovedo, Henrique
Publicado em: (2016)
school Aplicação para intervenção em terapia ocupacional com o Leap Motion
por: Costa, Pedro Miguel Ferreira
Publicado em: (2014)
por: Costa, Pedro Miguel Ferreira
Publicado em: (2014)
article Seeing or acting? the effect of performing gestures on foreign language vocabulary learning
por: García-Gámez, Ana Belén
Publicado em: (2021)
por: García-Gámez, Ana Belén
Publicado em: (2021)
groups A biological and real-time framework for hand gestures and head poses
por: Saleiro, Mário
Publicado em: (2013)
por: Saleiro, Mário
Publicado em: (2013)
school Gesture based persuasive interfaces for public ambient displays
por: Salvador, Ricardo Manuel da Silva
Publicado em: (2012)
por: Salvador, Ricardo Manuel da Silva
Publicado em: (2012)
school Interfaces inovadoras e de baixo custo para aplicações de Software - Mecanismos de interacção baseados no reconhecimento gestual
por: Quintela, Gustavo José Videira
Publicado em: (2012)
por: Quintela, Gustavo José Videira
Publicado em: (2012)
article On the utility of 3D hand cursors to explore medical volume datasets with a touchless interface.
por: Lopes, S
Publicado em: (2017)
por: Lopes, S
Publicado em: (2017)
groups A gestural interface for real-time composition: concepts and implementation
por: Coimbra, João
Publicado em: (2023)
por: Coimbra, João
Publicado em: (2023)
groups Designing a gestural interface for musical expression: notes on recent development
por: Coimbra, João
Publicado em: (2023)
por: Coimbra, João
Publicado em: (2023)
groups Tailored virtual reality and mobile application for motor rehabilitation
por: Lourenço F.
Publicado em: (2018)
por: Lourenço F.
Publicado em: (2018)
school Aplicação do Leap Motion na avaliação da doença de Parkinson
por: Reis, Ana Luísa dos Santos
Publicado em: (2018)
por: Reis, Ana Luísa dos Santos
Publicado em: (2018)
groups Gesture-Based Locomotion in Immersive VR Worlds with the Leap Motion Controller
por: Cardoso, Jorge C. S.
Publicado em: (2017)
por: Cardoso, Jorge C. S.
Publicado em: (2017)
school Exploring radar sensing for gesture recognition
por: Santana, Luís Fernando do Vale
Publicado em: (2021)
por: Santana, Luís Fernando do Vale
Publicado em: (2021)
school Gesture recognition for interaction tasks in immersive reality
por: Santos, José Luís Picão
Publicado em: (2024)
por: Santos, José Luís Picão
Publicado em: (2024)
school Neural basis of pantomime and intransitive gestures: an fMRI study
por: Pereira, Ana Rita Soares
Publicado em: (2018)
por: Pereira, Ana Rita Soares
Publicado em: (2018)
school In search of neural bases of pantomimes: fMRI evidence
por: Pereira, Natália Cristina Guerra
Publicado em: (2019)
por: Pereira, Natália Cristina Guerra
Publicado em: (2019)
groups One hand or two hands? 2D selection tasks with the leap motion device
por: Seixas, Manuel
Publicado em: (2015)
por: Seixas, Manuel
Publicado em: (2015)
book Gestures, Diagrams, and the Craft of Musical Composition
por: Aguiar, Vinícius de
Publicado em: (2024)
por: Aguiar, Vinícius de
Publicado em: (2024)
groups Physical computing instrument: designing a gestural interface for musical expression
por: Coimbra, João
Publicado em: (2023)
por: Coimbra, João
Publicado em: (2023)
school Continous hand gesture spotting for human-robot interaction
por: Simão, Miguel Ângelo Fernandes Castanheiro e
Publicado em: (2014)
por: Simão, Miguel Ângelo Fernandes Castanheiro e
Publicado em: (2014)
article A comparison of machine learning algorithms applied to hand gesture recognition
por: Trigueiros, Paulo
Publicado em: (2012)
por: Trigueiros, Paulo
Publicado em: (2012)
article Knowing how to do it or doing it? A double dissociation between tool-gesture production and tool-gesture knowledge
por: Valério, Daniela
Publicado em: (2021)
por: Valério, Daniela
Publicado em: (2021)
article Stereotyped movement recognition in children with ASD
por: Rodrigues, Jose L.
Publicado em: (2013)
por: Rodrigues, Jose L.
Publicado em: (2013)
article Tele-media-art: feasibility tests of web-based dance education for the blind using kinect and sound synthesis of motion
por: Dias, José Rodrigues
Publicado em: (2019)
por: Dias, José Rodrigues
Publicado em: (2019)
groups You move you interact:a full-body dance in-between reality and virtuality
por: Moura, João Martinho
Publicado em: (2008)
por: Moura, João Martinho
Publicado em: (2008)
article You move you interact: a full-body dance in-between reality and virtuality
por: Moura, João Martinho
Publicado em: (2008)
por: Moura, João Martinho
Publicado em: (2008)
Registos relacionados
-
groups Hand gestures recognition for an intelligent wheelchair steering command
por: Almeida, Patrícia
Publicado em: (2023) -
groups Separating gesture detection and application control concerns with a multimodal architecture
por: Morgado, Leonel
Publicado em: (2015) -
school Natural User Interfaces
por: Ferreira, Sara João Cardoso
Publicado em: (2014) -
article Hand/arm Gesture Segmentation by Motion Using IMU and EMG Sensing
por: Lopes, João
Publicado em: (2017) -
article Sign language learning using the hangman videogame
por: Soares, Filomena
Publicado em: (2016)