Publicação
Large-scale tactile detection system based on supervised learning for service robots human interaction
| Resumo: | In this work, a large-scale tactile detection system is proposed, whose development is based on a soft structure using Machine Learning and Computer Vision algorithms to map the surface of a forearm sleeve. The current application has a cylindrical design, whose dimensions intend to be like a human forearm or bicep. The model was developed assuming that deformations occur only at one section at a time. The goal for this system is to be coupled with the CHARMIE robot, a collaborative robot for domestic and medical environments. This system allows the contact detection of the entire forearm surface enabling interaction between a Human Being and a robot. A matrix with sections can be configured to present certain functionalities, allowing CHARMIE to detect contact in a particular section, and thus perform a specific behaviour. After building the dataset, an Artificial Neural Network (ANN) was created. This network was called Section Detection Network (SDN), and through Supervised Learning, a model was created to predict the contact location. Furthermore, Stratified K-Fold Cross Validation (SKFCV) was used to divide the dataset. All these steps resulted in Neural Network with a test data accuracy higher than 80%. Regarding the real-time evaluation, a graphical interface was structured to demonstrate the predicted class and the corresponding probability. This research concluded that the method described has enormous potential to be used as a tool for service robots allowing enhanced human-robot interaction. |
|---|---|
| Autores principais: | Cunha, Fábio |
| Outros Autores: | Ribeiro, Tiago; Lopes, Gil; Ribeiro, A. Fernando |
| Assunto: | Robotics Service robots Human-machine interface Touch sensor Machine Learning Artificial Neural Networks |
| Ano: | 2023 |
| País: | Portugal |
| Tipo de documento: | artigo |
| Tipo de acesso: | acesso aberto |
| Instituição associada: | Universidade do Minho |
| Idioma: | inglês |
| Origem: | RepositóriUM - Universidade do Minho |
Registos relacionados
article An approach to behavioural distraction patterns detection and classification in a human-robot interaction
por: Amaro, Bruno Filipe Viana
Publicado em: (2018)
por: Amaro, Bruno Filipe Viana
Publicado em: (2018)
article Building a behaviour architecture: An approach for promoting human-robot interaction
por: Amaro, Bruno
Publicado em: (2019)
por: Amaro, Bruno
Publicado em: (2019)
school Robotic soccer: behaviors for simulated humanoid robots
por: Resende, Francisco Manuel Gonçalves de
Publicado em: (2020)
por: Resende, Francisco Manuel Gonçalves de
Publicado em: (2020)
article Quantum Robotics, Neural Networks and the Quantum Force Interpretation
por: Gonçalves, Carlos Pedro
Publicado em: (2019)
por: Gonçalves, Carlos Pedro
Publicado em: (2019)
book Knowledge and tasks representation for an industrial robotic application
por: Bernardo, Rodrigo
Publicado em: (2018)
por: Bernardo, Rodrigo
Publicado em: (2018)
article FBG-based sensing system to improve tactile sensitivity of robotic manipulators working in unstructured environments
por: Biazi-Neto, Vitorino
Publicado em: (2023)
por: Biazi-Neto, Vitorino
Publicado em: (2023)
school Human-robot interaction for object transfer
por: Almeida, Luís Miguel Martins
Publicado em: (2016)
por: Almeida, Luís Miguel Martins
Publicado em: (2016)
book Knowledge and capabilities representation for visually guided robotic bin picking
por: Gonçalves, Paulo
Publicado em: (2019)
por: Gonçalves, Paulo
Publicado em: (2019)
article What is it about humanity that we can't give away to intelligent machines? A European perspective
por: Coombs, Crispin
Publicado em: (2021)
por: Coombs, Crispin
Publicado em: (2021)
article Frankie: an open-source educational robot for teaching robotics and artificial intelligence
por: Pimentel, C.
Publicado em: (2025)
por: Pimentel, C.
Publicado em: (2025)
school Detection of articulated objects for robotic applications
por: Pereira, Paulo Guilherme Soares
Publicado em: (2024)
por: Pereira, Paulo Guilherme Soares
Publicado em: (2024)
article Developing an automated system for shoe sole halogenation
por: Sepúlveda, João
Publicado em: (1997)
por: Sepúlveda, João
Publicado em: (1997)
groups Kinematic and dynamic 2D visual servoing
por: Gonçalves, Paulo
Publicado em: (2001)
por: Gonçalves, Paulo
Publicado em: (2001)
school Object detection with artificial vision and neural networks for service robots
por: Pinto, Tiago Alexandre Barbosa
Publicado em: (2018)
por: Pinto, Tiago Alexandre Barbosa
Publicado em: (2018)
article A hybrid supervised approach for human robot interaction with children with autism spectrum disorder
por: Silva, Vinicius Corrêa Alves
Publicado em: (2021)
por: Silva, Vinicius Corrêa Alves
Publicado em: (2021)
article Neuro-cognitive mechanisms of decision making in joint action: A human-robot interaction study
por: Bicho, E.
Publicado em: (2011)
por: Bicho, E.
Publicado em: (2011)
book A dynamic neural field approach to natural and efficient human-robot collaboration
por: Erlhagen, Wolfram
Publicado em: (2014)
por: Erlhagen, Wolfram
Publicado em: (2014)
article Vision and distance integrated sensor (Kinect) for an autonomous robot
por: Ribeiro, Paulo Rogério de Almeida
Publicado em: (2011)
por: Ribeiro, Paulo Rogério de Almeida
Publicado em: (2011)
school Holonomic control and behaviours for the CAMBADA robotic soccer team
por: Cunha, João Alexandre da Silva Costa e
Publicado em: (2009)
por: Cunha, João Alexandre da Silva Costa e
Publicado em: (2009)
school Recognition of human grasping patterns for intention prediction in collaborative tasks
por: Amaral, Pedro Miguel Loureiro
Publicado em: (2023)
por: Amaral, Pedro Miguel Loureiro
Publicado em: (2023)
school Time-constrained colored object detection for intelligent robots
por: Trifan, Alina Liliana
Publicado em: (2015)
por: Trifan, Alina Liliana
Publicado em: (2015)
school Machine learning methods for radar-based people detection
por: Castanheira, José Pedro Baião
Publicado em: (2019)
por: Castanheira, José Pedro Baião
Publicado em: (2019)
article Mobile robot competitions: fostering advances in research, development and education in robotics
por: Almeida, Luís B.
Publicado em: (2000)
por: Almeida, Luís B.
Publicado em: (2000)
article Advancing robotic assembly with BIM and mixed reality integration: an integration of computational and visual experience
por: Maurya, Ankita
Publicado em: (2025)
por: Maurya, Ankita
Publicado em: (2025)
groups Interaction human-robot : a methodological proposal to evaluate actions performed by robots to elderly
por: Pereira, Cristina
Publicado em: (2018)
por: Pereira, Cristina
Publicado em: (2018)
school Development of a front-end application for a human-robot collaborative framework
por: Martins, Guilherme da Silva Amorim
Publicado em: (2023)
por: Martins, Guilherme da Silva Amorim
Publicado em: (2023)
article End-to-end approach for autonomous driving: a supervised learning method using computer vision algorithms for dataset creation
por: Ribeiro, Inês A.
Publicado em: (2023)
por: Ribeiro, Inês A.
Publicado em: (2023)
school Objects and furniture manipulation in domestic environment using a service robot
por: Silva, Bruno Filipe Gonçalves
Publicado em: (2024)
por: Silva, Bruno Filipe Gonçalves
Publicado em: (2024)
book Proceedings of the 9th Conference on Autonomous Robot Systems and Competitions
por: Gonçalves, Paulo
Publicado em: (2009)
por: Gonçalves, Paulo
Publicado em: (2009)
article CHARMIE: a collaborative healthcare and home service and assistant robot for elderly care
por: Ribeiro, Tiago
Publicado em: (2021)
por: Ribeiro, Tiago
Publicado em: (2021)
school Project of an anthropomorphic manipulator for the CAMBADA@Home robot
por: Santos, Luís Filipe Pereira Almeida
Publicado em: (2013)
por: Santos, Luís Filipe Pereira Almeida
Publicado em: (2013)
article Multi-neural network localisation system with regression and classification on football autonomous robots
por: Lopes, Carolina Coelho
Publicado em: (2025)
por: Lopes, Carolina Coelho
Publicado em: (2025)
article Ergowear: an ambulatory, non-intrusive, and interoperable system towards a human-aware human-robot collaborative framework
por: Resende, Andre
Publicado em: (2021)
por: Resende, Andre
Publicado em: (2021)
article Minho robot football team
por: Machado, Carlos
Publicado em: (2000)
por: Machado, Carlos
Publicado em: (2000)
article Learning robotics: a review
por: Ribeiro, A. Fernando
Publicado em: (2020)
por: Ribeiro, A. Fernando
Publicado em: (2020)
article Grapevine yield components detection using image analysis: a case study with the white cultivar ‘Encruzado’
por: Vitorino, G.
Publicado em: (2021)
por: Vitorino, G.
Publicado em: (2021)
article A socially assistive robot for people with motor impairments
por: Pinheiro, Manuel
Publicado em: (2013)
por: Pinheiro, Manuel
Publicado em: (2013)
article Service robots in the hospitality industry: The case of Henn-na hotel, Japan
por: Reis, João
Publicado em: (2020)
por: Reis, João
Publicado em: (2020)
school Low cost inertial-based localization system for a service robot
por: Lino, Rúben José Simões
Publicado em: (2011)
por: Lino, Rúben José Simões
Publicado em: (2011)
book Touching but with the Eyes Only! The Effectiveness of Textured Packaging and the Moderating Effect of Previous Tactile Stimulation
por: Ferreira, Bruno
Publicado em: (2016)
por: Ferreira, Bruno
Publicado em: (2016)
Registos relacionados
-
article An approach to behavioural distraction patterns detection and classification in a human-robot interaction
por: Amaro, Bruno Filipe Viana
Publicado em: (2018) -
article Building a behaviour architecture: An approach for promoting human-robot interaction
por: Amaro, Bruno
Publicado em: (2019) -
school Robotic soccer: behaviors for simulated humanoid robots
por: Resende, Francisco Manuel Gonçalves de
Publicado em: (2020) -
article Quantum Robotics, Neural Networks and the Quantum Force Interpretation
por: Gonçalves, Carlos Pedro
Publicado em: (2019) -
book Knowledge and tasks representation for an industrial robotic application
por: Bernardo, Rodrigo
Publicado em: (2018)