A SDK improvement towards gesture support

• Author(s): Delgado, João Ricardo Ferreira
• Date: 2014
• Persistent ID: http://hdl.handle.net/10362/14100
• Origin: Repositório Institucional da UNL
• Subject(s): Kinect; SDK; Extension; Shape recognition; Template matching
• Document Type: Master thesis
• Language: English
• Advisor(s): Cardoso, Tiago
• Contributor(s): RUN

Description

Human-Computer Interaction have been one of the main focus of the technological community, specially the Natural User Interfaces (NUI) field of research as, since the launch of the Kinect Sensor, the goal to achieve fully natural interfaces just got a lot closer to reality. Taking advantage of this conditions the following research work proposes to compute the hand skeleton in order to recognize Sign Language Shapes. The proposed solution uses the Kinect Sensor to achieve a good segmentation and image analysis algorithms to extend the skeleton from the extraction of high-level features. In order to recognize complex hand shapes the current research work proposes the redefinition of the hand contour making it immutable to translation, rotation and scaling operations, and a set of tools to achieve a good recognition. The validation of the proposed solution extended the Kinects Software Development Kit to allow the developer to access the new set of inferred points and created a template-matching based platform that uses the contour to define the hand shape, this prototype was tested in a set of predefined conditions and showed to have a good success ration and has proven to be eligible for real-time scenarios.