Publication
Evolutionary online behaviour learning and adaptation in real robots
| Summary: | Online evolution of behavioural control on real robots is an open-ended approach to autonomous learning and adaptation: robots have the potential to automatically learn new tasks and to adapt to changes in environmental conditions, or to failures in sensors and/or actuators. However, studies have so far almost exclusively been carried out in simulation because evolution in real hardware has required several days or weeks to produce capable robots. In this article, we successfully evolve neural network-based controllers in real robotic hardware to solve two single-robot tasks and one collective robotics task. Controllers are evolved either from random solutions or from solutions pre-evolved in simulation. In all cases, capable solutions are found in a timely manner (1 h or less). Results show that more accurate simulations may lead to higher-performing controllers, and that completing the optimization process in real robots is meaningful, even if solutions found in simulation differ from solutions in reality. We furthermore demonstrate for the first time the adaptive capabilities of online evolution in real robotic hardware, including robots able to overcome faults injected in the motors of multiple units simultaneously, and to modify their behaviour in response to changes in the task requirements. We conclude by assessing the contribution of each algorithmic component on the performance of the underlying evolutionary algorithm. |
|---|---|
| Main Authors: | Silva, F. |
| Other Authors: | Correia, L.; Christensen, A. L. |
| Subject: | Online evolution Learning Fault tolerance Real robots |
| Year: | 2017 |
| Country: | Portugal |
| Document type: | article |
| Access type: | open access |
| Associated institution: | ISCTE |
| Language: | English |
| Origin: | Repositório ISCTE |
Similar Items
article Application-level fault tolerance in real-time embedded systems
by: Afonso, Francisco
Published: (2008)
by: Afonso, Francisco
Published: (2008)
article Open issues in evolutionary robotics
by: Silva, F.
Published: (2016)
by: Silva, F.
Published: (2016)
article Distributed multi-robot patrol: a scalable and fault-tolerant framework
by: Portugal, David
Published: (2013)
by: Portugal, David
Published: (2013)
groups Adaptation of robot behaviour through online evolution and neuromodulated learning
by: Silva, F.
Published: (2012)
by: Silva, F.
Published: (2012)
article Performability evaluation of PROFIBUS-DP multi-master networks in relevant industrial scenarios
by: Carvalho, José Augusto
Published: (2007)
by: Carvalho, José Augusto
Published: (2007)
school Online Evolution of Robotic Controllers
by: Nascimento, Davi Campos do
Published: (2025)
by: Nascimento, Davi Campos do
Published: (2025)
article Evaluating evolutionary algorithms and differential evolution for the online optimization of fermentation processes
by: Rocha, Miguel
Published: (2007)
by: Rocha, Miguel
Published: (2007)
assignment Distributed computer-controlled systems: the DEAR-COTS approach
by: Veríssimo, Paulo
Published: (2000)
by: Veríssimo, Paulo
Published: (2000)
article Real Time Fault Injection Using On Chip Debug Infrastructures – A Case Study
by: Fidalgo, André Vaz
Published: (2006)
by: Fidalgo, André Vaz
Published: (2006)
article Aspect-oriented fault tolerance for real-time embedded systems
by: Afonso, Francisco
Published: (2008)
by: Afonso, Francisco
Published: (2008)
groups Fault detection agents based on wavelet adaptive thresholds
by: Mendes, Mário J. G. C.
Published: (2010)
by: Mendes, Mário J. G. C.
Published: (2010)
article Replication management in reliable real-time systems
by: Pinho, Luís Miguel
Published: (2004)
by: Pinho, Luís Miguel
Published: (2004)
school Fault Detection, Diagnosis and Fault Tolerance Approaches in Dynamic Systems based on Black-Box Models
by: Brito Palma, Luis
Published: (2007)
by: Brito Palma, Luis
Published: (2007)
article Fault-Tolerant Back-to-Back Converter for Direct-Drive PMSG Wind Turbines Using Direct Torque and Power Control Techniques
by: Jlassi, Imed
Published: (2019)
by: Jlassi, Imed
Published: (2019)
article Diagnosis of Open-Switch and Current Sensor Faults in PMSM Drives Through Stator Current Analysis
by: Khojet El Khil, Sejir
Published: (2019)
by: Khojet El Khil, Sejir
Published: (2019)
school Evolutionary online behaviour learning and adaptation in robotic systems
by: Silva, Fernando Goulart da
Published: (2017)
by: Silva, Fernando Goulart da
Published: (2017)
article An aspect-oriented approach to fault-tolerance in grid platforms
by: Medeiros, Bruno
Published: (2011)
by: Medeiros, Bruno
Published: (2011)
book A review of fault tolerant design in wave energy converters
by: Kamarlouei, Mojtaba
Published: (2018)
by: Kamarlouei, Mojtaba
Published: (2018)
assignment State Machine Replication for the Masses with BFT-SMaRt
by: Sousa, João
Published: (2013)
by: Sousa, João
Published: (2013)
groups Reconfiguration Strategies for Critical Adaptive Distributed Embedded Systems
by: Ballesteros, Alberto
Published: (2018)
by: Ballesteros, Alberto
Published: (2018)
school Fault Tolerant Control of a X8-VB Quadcopter
by: Brito, Vasco da Silva
Published: (2016)
by: Brito, Vasco da Silva
Published: (2016)
assignment How Practical Are Intrusion-Tolerant Distributed Systems?
by: Obelheiro, Rafael R.
Published: (2006)
by: Obelheiro, Rafael R.
Published: (2006)
assignment Intrusion-Tolerant Architectures: Concepts and Design
by: Veríssimo, Paulo
Published: (2003)
by: Veríssimo, Paulo
Published: (2003)
groups Timing analysis of an active replication scheme for the road side units of vehicular networks
by: Almeida, João
Published: (2016)
by: Almeida, João
Published: (2016)
groups Wireless vehicular communications for automatic incident detection and recovery
by: Ferreira, Joaquim José Castro
Published: (2012)
by: Ferreira, Joaquim José Castro
Published: (2012)
assignment The Timely Computing Base
by: Veríssimo, Paulo
Published: (1999)
by: Veríssimo, Paulo
Published: (1999)
article Sensor Fault Detection and Identification in a Pilot Plant Under Process Control
by: Afonso, P. A. F. N. A.
Published: (1998)
by: Afonso, P. A. F. N. A.
Published: (1998)
school Experiments in evolutionary collective robotics
by: Bastos, André González Amor de
Published: (2011)
by: Bastos, André González Amor de
Published: (2011)
assignment Active Quorum Systems: Specification and Correctness Proof
by: Bessani, Alysson
Published: (2010)
by: Bessani, Alysson
Published: (2010)
assignment On the Effects of Diversity on Intrusion Tolerance
by: Bessani, Alysson Neves
Published: (2008)
by: Bessani, Alysson Neves
Published: (2008)
article A Medium Guardian for Enhanced Dependability in Safety-Critical Wireless Systems
by: Almeida, João Miguel Pereira de
Published: (2018)
by: Almeida, João Miguel Pereira de
Published: (2018)
groups A Fault Diagnosis Scheme Based on the Normalized Indexes of the Images eccentricity for a Multilevel Converter of a Switched Reluctance Motor Drive
by: Amaral, Tito G.
Published: (2022)
by: Amaral, Tito G.
Published: (2022)
article Mitigating Virtualization Failures Through Migration to a Co-Located Hypervisor
by: Cerveira, Frederico
Published: (2021)
by: Cerveira, Frederico
Published: (2021)
school Localization and Trajectory Control Algorithms Applied on Drones
by: Brito, Alexandre Filipe Zambujo de
Published: (2018)
by: Brito, Alexandre Filipe Zambujo de
Published: (2018)
school Resilient federated learning framework
by: Almeida, Leonardo
Published: (2025)
by: Almeida, Leonardo
Published: (2025)
article Inter-domain traffic routing in vehicular delay tolerant networks
by: Farahmand, Farid
Published: (2010)
by: Farahmand, Farid
Published: (2010)
assignment Timing Failure Detection with a Timely Computing Base
by: Casimiro, António
Published: (1999)
by: Casimiro, António
Published: (1999)
article State-machine replication for planet-scale systems
by: Enes, Vitor
Published: (2020)
by: Enes, Vitor
Published: (2020)
assignment Spin One’s Wheels? Byzantine Fault Tolerance with a Spinning Primary
by: Bessani, Allyson Neves
Published: (2009)
by: Bessani, Allyson Neves
Published: (2009)
assignment From Resilience-Building to Resilience-Scaling Technologies: Directions -- ReSIST NoE Deliverable D13
by: Banatre, M.
Published: (2007)
by: Banatre, M.
Published: (2007)
Similar Items
-
article Application-level fault tolerance in real-time embedded systems
by: Afonso, Francisco
Published: (2008) -
article Open issues in evolutionary robotics
by: Silva, F.
Published: (2016) -
article Distributed multi-robot patrol: a scalable and fault-tolerant framework
by: Portugal, David
Published: (2013) -
groups Adaptation of robot behaviour through online evolution and neuromodulated learning
by: Silva, F.
Published: (2012) -
article Performability evaluation of PROFIBUS-DP multi-master networks in relevant industrial scenarios
by: Carvalho, José Augusto
Published: (2007)