Publicação
Deep reinforcement learning applied to a robotic pick-and-place application
| Resumo: | Industrial robot manipulators are widely used for repetitive applications that require high precision, like pick-and-place. In many cases, the movements of industrial robot manipulators are hard-coded or manually defined, and need to be adjusted if the objects being manipulated change position. To increase flexibility, an industrial robot should be able to adjust its configuration in order to grasp objects in variable/ unknown positions. This can be achieved by off-the-shelf visionbased solutions, but most require prior knowledge about each object to be manipulated. To address this issue, this work presents a ROS-based deep reinforcement learning solution to robotic grasping for a Collaborative Robot (Cobot) using a depth camera. The solution uses deep Q-learning to process the color and depth images and generate a ϵ- greedy policy used to define the robot action. The Q-values are estimated using Convolutional Neural Network (CNN) based on pre-trained models for feature extraction. Experiments were carried out in a simulated environment to compare the performance of four different pretrained CNN models (RexNext, MobileNet, MNASNet and DenseNet). Results show that the best performance in our application was reached by MobileNet, with an average of 84 % accuracy after training in simulated environment. |
|---|---|
| Autores principais: | Gomes, Natanael Magno |
| Outros Autores: | Martins, Felipe N.; Lima, José; Wörtche, Heinrich |
| Assunto: | Cobots Reinforcement learning Computer vision Pick-and-place Grasping |
| Ano: | 2021 |
| País: | Portugal |
| Tipo de documento: | comunicação em conferência |
| Tipo de acesso: | acesso restrito |
| Instituição associada: | Instituto Politécnico de Bragança |
| Idioma: | inglês |
| Origem: | Biblioteca Digital do IPB |
Registos relacionados
article Reinforcement learning for collaborative robots pick-and-place applications: a case study
por: Gomes, Natanael Magno
Publicado em: (2022)
por: Gomes, Natanael Magno
Publicado em: (2022)
article Part alignment identification and adaptive pick-andplace operation for flat surfaces
por: Costa, Paulo Gomes da
Publicado em: (2013)
por: Costa, Paulo Gomes da
Publicado em: (2013)
school Probabilistic Learning of Human Manipulation of Objects towards Autonomous Robotic Grasping
por: Faria, Diego Resende
Publicado em: (2014)
por: Faria, Diego Resende
Publicado em: (2014)
article Statistical methodologies for determining critical parameters in a pick-and-place process on a surface mount device line
por: Lima, S.
Publicado em: (2025)
por: Lima, S.
Publicado em: (2025)
school Modeling and simulation of a Pick&Place system with OpenModelica
por: Monteiro, Alberto José Cibrão
Publicado em: (2023)
por: Monteiro, Alberto José Cibrão
Publicado em: (2023)
article An optimization approach for the inverse kinematics of a highly redundant robot
por: Costa, Paulo Gomes da
Publicado em: (2016)
por: Costa, Paulo Gomes da
Publicado em: (2016)
article Human-robot collaboration (HRC) with vision inspection for PCB assembly
por: Queirós, Mauro Daniel Monteiro
Publicado em: (2022)
por: Queirós, Mauro Daniel Monteiro
Publicado em: (2022)
article A dynamic model for action understanding and goal-directed imitation
por: Erlhagen, Wolfram
Publicado em: (2006)
por: Erlhagen, Wolfram
Publicado em: (2006)
article Mobile robot for autonomous golf balls picking
por: Pacheco, Luís Fernando Costa
Publicado em: (2008)
por: Pacheco, Luís Fernando Costa
Publicado em: (2008)
article Autonomous golf ball picking robot design and development
por: Pereira, Nino
Publicado em: (2012)
por: Pereira, Nino
Publicado em: (2012)
article Prevalence of eating disorders and picking-nibbling in elderly women
por: Conceição, Eva Martins
Publicado em: (2017)
por: Conceição, Eva Martins
Publicado em: (2017)
article A golf ball picking robot design and development
por: Pereira, Nino
Publicado em: (2012)
por: Pereira, Nino
Publicado em: (2012)
school Impacto da tecnologia pick-to-light no processamento de encomendas em armazéns
por: Pereira, Catarina Martins Marques
Publicado em: (2023)
por: Pereira, Catarina Martins Marques
Publicado em: (2023)
school Development of a solution that allows integration of a collaborative robot onto an industrial AGV – AGV and GUI related aspects
por: Souza, Floyd Wayne Bernard d'
Publicado em: (2019)
por: Souza, Floyd Wayne Bernard d'
Publicado em: (2019)
article Picking optimization
por: Santos, Jorge
Publicado em: (2014)
por: Santos, Jorge
Publicado em: (2014)
article Work cell for assembling small components in PCB
por: Queirós, Mauro Daniel Monteiro
Publicado em: (2022)
por: Queirós, Mauro Daniel Monteiro
Publicado em: (2022)
article Restructuring picking and restocking processes on a hypermarket
por: Guimarães, Rafaela
Publicado em: (2022)
por: Guimarães, Rafaela
Publicado em: (2022)
school The contribution of the user experiences goals for designing better cobots: A systematic literature review and a case study of human-robot collaboration in a picking task
por: Duarte, Inês Margarida Lopes
Publicado em: (2022)
por: Duarte, Inês Margarida Lopes
Publicado em: (2022)
article Collective Intelligence Application in a Kitting Picking Zone of the Automotive Industry
por: Zapata, Santiago Montoya
Publicado em: (2023)
por: Zapata, Santiago Montoya
Publicado em: (2023)
school O processo de order-picking no retalho online : análise e sugestões de melhoria do processo de order-picking da Auchan Retail Portugal
por: Araújo, Lídia Félix
Publicado em: (2022)
por: Araújo, Lídia Félix
Publicado em: (2022)
school Redefinição dos processos de arrumação e de picking de um armazém de matéria-prima do setor farmacêutico
por: Ferraz, Ana Carolina de Matos Melo
Publicado em: (2020)
por: Ferraz, Ana Carolina de Matos Melo
Publicado em: (2020)
school Almond variety detection using deep learning
por: Benarous, Ahmed Omar Farouq
Publicado em: (2020)
por: Benarous, Ahmed Omar Farouq
Publicado em: (2020)
school Reinforcement Learning in the Navigation of Mobile Robots
por: Alves, Diogo António Ferreira Temporão
Publicado em: (2019)
por: Alves, Diogo António Ferreira Temporão
Publicado em: (2019)
article Place identity and place scale: the impact of place salience.
por: Bernardo, Fátima
Publicado em: (2014)
por: Bernardo, Fátima
Publicado em: (2014)
school Aplicações de robótica industrial : estágio na Fluidotronica
por: Oliveira, Rúben Filipe Tavares
Publicado em: (2026)
por: Oliveira, Rúben Filipe Tavares
Publicado em: (2026)
school Aplicações Industriais com Robôs Colaborativos
por: Ferreira, Pedro Rafael Coelho
Publicado em: (2023)
por: Ferreira, Pedro Rafael Coelho
Publicado em: (2023)
school Motion planning using DeepRL, applied to an industrial forklift pallet picking problem
por: Godinho, Francisco José Pessoa
Publicado em: (2025)
por: Godinho, Francisco José Pessoa
Publicado em: (2025)
school Otimização de operações de picking através de uma eficiente localização do armazenamento
por: Mansilha, Mariana de Carvalho
Publicado em: (2024)
por: Mansilha, Mariana de Carvalho
Publicado em: (2024)
article Ergonomics and human factors as a requirement to implement safer collaborative robotic workstations: a literature review
por: Cardoso, João André Vieira
Publicado em: (2021)
por: Cardoso, João André Vieira
Publicado em: (2021)
school Estimating discrete object orientation based on 2D images using deep learning techniques
por: Yahia, Youssef Bel Haj
Publicado em: (2024)
por: Yahia, Youssef Bel Haj
Publicado em: (2024)
school Deep reinforcement learning for robot navigation systems
por: Ribeiro, Tiago Alcântara
Publicado em: (2019)
por: Ribeiro, Tiago Alcântara
Publicado em: (2019)
school Reinforcement Learning para Controlo de Robótica Manipulativa com recurso a Simulação: Equilíbrio de objetos sujeitos a perturbações e instabilidade
por: Ferreira, Tomás Frias
Publicado em: (2025)
por: Ferreira, Tomás Frias
Publicado em: (2025)
school Análise e melhoria da atividade de picking para o abastecimento da produção
por: Lai, Wu Seong
Publicado em: (2022)
por: Lai, Wu Seong
Publicado em: (2022)
school Development of a control system for mobile robots with robotic arms: Application to picking tasks using neural networks
por: Pires, Tiago Albino Fontainhas
Publicado em: (2025)
por: Pires, Tiago Albino Fontainhas
Publicado em: (2025)
school A integração omnicanal e os novos processos de picking : caso El Corte Inglés
por: Baptista, Carolina Gomes
Publicado em: (2024)
por: Baptista, Carolina Gomes
Publicado em: (2024)
article A review on egomotion by means of differential epipolar geometry applied to the movement of a mobile robot
por: Armangué, Xavier
Publicado em: (2003)
por: Armangué, Xavier
Publicado em: (2003)
school Análise e dimensionamento de um sistema de picking num novo armazém de uma empresa de produção e distribuição de bebidas
por: Cardoso, Ana Catarina Lourenço
Publicado em: (2017)
por: Cardoso, Ana Catarina Lourenço
Publicado em: (2017)
school Learning to play DCSS with Deep Reinforcement Learning
por: Gonçalves, André Almeida
Publicado em: (2019)
por: Gonçalves, André Almeida
Publicado em: (2019)
article Localization of a mobile autonomous robot based on image analysis
por: Ribeiro, A. Fernando
Publicado em: (2008)
por: Ribeiro, A. Fernando
Publicado em: (2008)
school Motion planning for robotic arms integrated on mobile platforms for internal logistics tasks
por: Matos, Antonio João Gonçalves
Publicado em: (2025)
por: Matos, Antonio João Gonçalves
Publicado em: (2025)
Registos relacionados
-
article Reinforcement learning for collaborative robots pick-and-place applications: a case study
por: Gomes, Natanael Magno
Publicado em: (2022) -
article Part alignment identification and adaptive pick-andplace operation for flat surfaces
por: Costa, Paulo Gomes da
Publicado em: (2013) -
school Probabilistic Learning of Human Manipulation of Objects towards Autonomous Robotic Grasping
por: Faria, Diego Resende
Publicado em: (2014) -
article Statistical methodologies for determining critical parameters in a pick-and-place process on a surface mount device line
por: Lima, S.
Publicado em: (2025) -
school Modeling and simulation of a Pick&Place system with OpenModelica
por: Monteiro, Alberto José Cibrão
Publicado em: (2023)