Publicação
Human-Exoskeleton Interaction Simulation Framework via Deep Reinforcement Learning
| Resumo: | Designing and controlling lower-limb exoskeletons is a complex and costly process that requires extensive prototyping, human testing, and iterative refinement. A key challenge in active exoskeleton development is accurately perceiving human-robot interaction (HRI) and delivering practical assistance through advanced control strategies. Simulating HRI in controlled environments offers a powerful alternative, enabling efficient experiment design and assistive device development while reducing time, costs, and reliance on physical testing. This paper presents a simulation framework based on deep reinforcement learning (DRL) to investigate the interaction dynamics between human locomotion and powered lower-limb exoskeletons, utilizing the OpenSim physics-based simulator. A musculoskeletal model, integrated with an exoskeleton, functions as an agent that generates muscle forces derived from kinematics, ground reaction forces, and muscle data. The DRL architecture enables the agent to learn natural walking motion through training with experimental data in the simulator. Results demonstrate the model’s ability to simulate locomotion dynamics and provide insights into several factors, including muscle activity, muscle forces, human-exoskeleton interaction, and gait patterns. |
|---|---|
| Autores principais: | SIlvino, Diogo Roseira |
| Outros Autores: | Figueiredo, Joana; Santos, Cristina |
| Assunto: | Human-Robot Interaction Deep Reinforcement Learning Exoskeleton |
| Ano: | 2025 |
| País: | Portugal |
| Tipo de documento: | comunicação em conferência |
| Tipo de acesso: | acesso aberto |
| Instituição associada: | Universidade do Minho |
| Idioma: | inglês |
| Origem: | RepositóriUM - Universidade do Minho |
Registos relacionados
article Lab experiences with a linkage exoskeleton for walking assistance
por: Silva, I.
Publicado em: (2015)
por: Silva, I.
Publicado em: (2015)
article Human-robot joint misalignment, physical interaction, and gait kinematic assessment in ankle-foot orthoses
por: Andrade, Ricardo Luís Nunes
Publicado em: (2024)
por: Andrade, Ricardo Luís Nunes
Publicado em: (2024)
school Adaption of medical exoskeleton gloves to industrial use
por: Cabral, Bernardo Mazzini
Publicado em: (2024)
por: Cabral, Bernardo Mazzini
Publicado em: (2024)
article Real-time torque estimation using human and sensor data fusion for exoskeleton assistance
por: Moreira, Luís Carlos Rodrigues
Publicado em: (2024)
por: Moreira, Luís Carlos Rodrigues
Publicado em: (2024)
article Wearable biofeedback improves human-robot compliance during ankle-foot exoskeleton-assisted gait training: a pre-post controlled study in healthy participants
por: Pinheiro, Cristiana
Publicado em: (2020)
por: Pinheiro, Cristiana
Publicado em: (2020)
article Hand exoskeleton for rehabilitation and functionalization
por: Leite, Tiago
Publicado em: (2022)
por: Leite, Tiago
Publicado em: (2022)
article Influence of the robotic exoskeleton Lokomat on the control of human gait : an electromyographic and kinematic analysis
por: Barroso, Filipe André Oliveira
Publicado em: (2013)
por: Barroso, Filipe André Oliveira
Publicado em: (2013)
article Towards a more efficient human-exoskeleton assistance
por: Monteiro, Sara
Publicado em: (2023)
por: Monteiro, Sara
Publicado em: (2023)
article Locomotion mode prediction in real life walking with and without ankle-foot exoskeleton assistance
por: Carvalho, Simão Pedro Fernandes Machado Dias
Publicado em: (2025)
por: Carvalho, Simão Pedro Fernandes Machado Dias
Publicado em: (2025)
article Assessing the short-term effects of dual back-support exoskeleton within logistics operations
por: Cardoso, André
Publicado em: (2024)
por: Cardoso, André
Publicado em: (2024)
school Deep reinforcement learning for robotic manipulation tasks
por: Pereira, Bruno Alexandre Barbosa
Publicado em: (2021)
por: Pereira, Bruno Alexandre Barbosa
Publicado em: (2021)
article Feedback-Error Learning for time-effective gait trajectory tracking in wearable exoskeletons
por: Figueiredo, Joana
Publicado em: (2023)
por: Figueiredo, Joana
Publicado em: (2023)
article Evaluating exoskeletons for WMSD prevention: a systematic review of applications and ergonomic approach in occupational settings
por: Cardoso, André
Publicado em: (2024)
por: Cardoso, André
Publicado em: (2024)
school Deep reinforcement learning for robot navigation systems
por: Ribeiro, Tiago Alcântara
Publicado em: (2019)
por: Ribeiro, Tiago Alcântara
Publicado em: (2019)
school Robotic soccer: behaviors for simulated humanoid robots
por: Resende, Francisco Manuel Gonçalves de
Publicado em: (2020)
por: Resende, Francisco Manuel Gonçalves de
Publicado em: (2020)
school Learning to play DCSS with Deep Reinforcement Learning
por: Gonçalves, André Almeida
Publicado em: (2019)
por: Gonçalves, André Almeida
Publicado em: (2019)
article Combining YOLO and deep reinforcement learning for autonomous driving in public roadworks scenarios
por: Andrade, Nuno
Publicado em: (2022)
por: Andrade, Nuno
Publicado em: (2022)
article A real-time kinematic-based locomotion mode prediction algorithm for an ankle orthosis
por: Moreira, Luís Carlos Rodrigues
Publicado em: (2024)
por: Moreira, Luís Carlos Rodrigues
Publicado em: (2024)
article Patient-driven hybrid FES-exoskeleton control with adaptive band-based assistance
por: Martins, Jorge Miguel Ribeiro
Publicado em: (2025)
por: Martins, Jorge Miguel Ribeiro
Publicado em: (2025)
article Comparison of on-policy deep reinforcement learning A2C with off-policy DQN in irrigation optimization : a case study at a site in Portugal
por: Alibabaei, Khadijeh
Publicado em: (2022)
por: Alibabaei, Khadijeh
Publicado em: (2022)
article A reinforcement learning algorithm for improving the generation of telerehabilitation activities of ABI patients
por: Zhinin-Vera, Luis
Publicado em: (2023)
por: Zhinin-Vera, Luis
Publicado em: (2023)
school Human-in-the-loop control for lower limb assistance driven by exoskeleton
por: Monteiro, Sara Margarida Alves
Publicado em: (2023)
por: Monteiro, Sara Margarida Alves
Publicado em: (2023)
school Analysis of the in vivo measured loads in the hip joint for weight-bearing activities with and without exoskeletons
por: Machado, Ana Rita da Silva
Publicado em: (2023)
por: Machado, Ana Rita da Silva
Publicado em: (2023)
school Deep reinforcement learning-based time series forecasting in electric energy harvesting
por: Fonte, Tiago Mateus Silveira Lourenço da
Publicado em: (2023)
por: Fonte, Tiago Mateus Silveira Lourenço da
Publicado em: (2023)
article Deep learning-based approaches for human motion decoding in smart walkers for rehabilitation
por: Gonçalves, Carolina
Publicado em: (2023)
por: Gonçalves, Carolina
Publicado em: (2023)
groups Interaction human-robot : a methodological proposal to evaluate actions performed by robots to elderly
por: Pereira, Cristina
Publicado em: (2018)
por: Pereira, Cristina
Publicado em: (2018)
article Tuning lysozyme nanofibers dimensions using deep eutectic solvents for improved reinforcement ability
por: Silva, Nuno H. C. S.
Publicado em: (2018)
por: Silva, Nuno H. C. S.
Publicado em: (2018)
article Building a behaviour architecture: An approach for promoting human-robot interaction
por: Amaro, Bruno
Publicado em: (2019)
por: Amaro, Bruno
Publicado em: (2019)
school Machine learning agents for computer games
por: Araújo, Miguel Diogo Ferraz
Publicado em: (2021)
por: Araújo, Miguel Diogo Ferraz
Publicado em: (2021)
school Analysis of human-computer interaction time series using Deep Learning
por: Pinto, José Pedro Milhazes Carvalho
Publicado em: (2021)
por: Pinto, José Pedro Milhazes Carvalho
Publicado em: (2021)
school End-to-end reinforcement learning for autonomous driving in urban environments
por: Coelho, Daniel Filipe Silveira
Publicado em: (2024)
por: Coelho, Daniel Filipe Silveira
Publicado em: (2024)
article Real-time detection of vine trunk for robot localization using deep learning models developed for edge TPU devices
por: Alibabaei, Khadijeh
Publicado em: (2022)
por: Alibabaei, Khadijeh
Publicado em: (2022)
school Mobile robot navigation using reinforcement learning
por: Silva, Diogo Vidal e
Publicado em: (2019)
por: Silva, Diogo Vidal e
Publicado em: (2019)
article Modelling a Deep Learning Framework for recognition of human actions on video
por: Santos, Flávio
Publicado em: (2021)
por: Santos, Flávio
Publicado em: (2021)
article An approach to behavioural distraction patterns detection and classification in a human-robot interaction
por: Amaro, Bruno Filipe Viana
Publicado em: (2018)
por: Amaro, Bruno Filipe Viana
Publicado em: (2018)
school Robotic implantation of intracerebral electrodes for deep brain stimulation
por: Faria, Carlos André de Oliveira
Publicado em: (2012)
por: Faria, Carlos André de Oliveira
Publicado em: (2012)
article A hybrid supervised approach for human robot interaction with children with autism spectrum disorder
por: Silva, Vinicius Corrêa Alves
Publicado em: (2021)
por: Silva, Vinicius Corrêa Alves
Publicado em: (2021)
article Robotic implantation of intracerebral electrodes for deep brain stimulation
por: Faria, Carlos André de Oliveira
Publicado em: (2013)
por: Faria, Carlos André de Oliveira
Publicado em: (2013)
article A deep learning-based dirt detection computer vision system for floor-cleaning robots with improved data collection
por: Canedo, Daniel
Publicado em: (2021)
por: Canedo, Daniel
Publicado em: (2021)
article Contactless human-computer interaction using a Deep Neural Network Pipeline for real-time video interpretation and classification
por: Sousa, Regina
Publicado em: (2021)
por: Sousa, Regina
Publicado em: (2021)
Registos relacionados
-
article Lab experiences with a linkage exoskeleton for walking assistance
por: Silva, I.
Publicado em: (2015) -
article Human-robot joint misalignment, physical interaction, and gait kinematic assessment in ankle-foot orthoses
por: Andrade, Ricardo Luís Nunes
Publicado em: (2024) -
school Adaption of medical exoskeleton gloves to industrial use
por: Cabral, Bernardo Mazzini
Publicado em: (2024) -
article Real-time torque estimation using human and sensor data fusion for exoskeleton assistance
por: Moreira, Luís Carlos Rodrigues
Publicado em: (2024) -
article Wearable biofeedback improves human-robot compliance during ankle-foot exoskeleton-assisted gait training: a pre-post controlled study in healthy participants
por: Pinheiro, Cristiana
Publicado em: (2020)