Publicação
Artificial intelligence-based control of autonomous vehicles in simulation: a CNN vs. RL case study
| Resumo: | The article provides a comparison of Convolutional Neural Network (CNN) and Reinforcement Learning (RL) applied to the field of autonomous driving within the CARLA (CAr Learning to Act) simulator for training and evaluation. The analysis of results revealed CNNs better overall performance, as it demonstrated a more refined driving experience, shorter training durations, and a more straightforward learning curve and optimization process. However, it required data labelling. In contrast, RL relayed on an exhaustive (unsupervised) exploration of different models, ultimately selecting the model at timestep 600,000, which had the highest mean reward. Nevertheless, RL’s approach revealed its susceptibility to excessive oscillations and inconsistencies, necessitating additional optimization and tuning of hyperparameters and reward functions. This conclusion is further substantiated by a range of used performance metrics (objective and subjective), designed to assess the performance of each approach. |
|---|---|
| Autores principais: | Vasiljević, Ive |
| Outros Autores: | Musić, Josip; Lima, José |
| Assunto: | Reinforcement learning CNN CARLA simulator |
| Ano: | 2024 |
| País: | Portugal |
| Tipo de documento: | comunicação em conferência |
| Tipo de acesso: | acesso aberto |
| Instituição associada: | Instituto Politécnico de Bragança |
| Idioma: | inglês |
| Origem: | Biblioteca Digital do IPB |
Registos relacionados
article Adaptive Convolutional Neural Network for Predicting Steering Angle and Acceleration on Autonomous Driving Scenario
por: Vasiljević, Ive
Publicado em: (2024)
por: Vasiljević, Ive
Publicado em: (2024)
article A Reinforcement Learning Assisted Eye-Driven Computer Game Employing a Decision Tree-Based Approach and CNN Classification
por: Perdiz, João
Publicado em: (2021)
por: Perdiz, João
Publicado em: (2021)
article GNSS simulation for automotive: introducing 3D scene-dependent multipath with CARLA
por: Pendão, Cristiano Gonçalves
Publicado em: (2025)
por: Pendão, Cristiano Gonçalves
Publicado em: (2025)
article Comparative Analysis of Windows for Speech Emotion Recognition Using CNN
por: Teixeira, Felipe
Publicado em: (2024)
por: Teixeira, Felipe
Publicado em: (2024)
school Realidades desvirtuadas: Entre o otimismo e o não-conformismo de Carla Filipe
por: Borges, Joana Oliveira
Publicado em: (2023)
por: Borges, Joana Oliveira
Publicado em: (2023)
school O desafio da criação de conteúdos exclusivos online: O caso da CNN Portugal
por: Gonçalves, Mariana Pereira
Publicado em: (2024)
por: Gonçalves, Mariana Pereira
Publicado em: (2024)
school As fontes de informação na cobertura do conflito israelo-árabe: Análise ao digital da CNN Portugal
por: Teixeira, Diana Isabel Silva
Publicado em: (2024)
por: Teixeira, Diana Isabel Silva
Publicado em: (2024)
school As representações dos atores políticos Putin e Zelensky nos programas Agora CNN, CNN Prime Time e CNN Meia Noite
por: Ângelo, Jéssica Soraia Palma
Publicado em: (2024)
por: Ângelo, Jéssica Soraia Palma
Publicado em: (2024)
school A cobertura mediática da guerra na Ucrânia pela CNN Portugal
por: Pacheco, Mariana Asseiceiro Silva
Publicado em: (2024)
por: Pacheco, Mariana Asseiceiro Silva
Publicado em: (2024)
article Comparing RL policies for robotic pusher
por: Bonjour, Pedro
Publicado em: (2026)
por: Bonjour, Pedro
Publicado em: (2026)
article Detection of Microcalcifications in Digital Breast Tomosynthesis using Faster R-CNN and 3D Volume Rendering
por: Matela, Nuno
Publicado em: (2022)
por: Matela, Nuno
Publicado em: (2022)
article Detection of Microcalcifications in Digital Breast Tomosynthesis using Faster R-CNN and 3D Volume Rendering
por: Mota, Ana M.
Publicado em: (2022)
por: Mota, Ana M.
Publicado em: (2022)
article Deep learning-based localization approach for autonomous robots in the robotAtFactory 4.0 competition
por: Klein, Luan C.
Publicado em: (2024)
por: Klein, Luan C.
Publicado em: (2024)
article Automated Lung Sound Classification Using a Hybrid CNN-LSTM Network and Focal Loss Function
por: Petmezas, Georgios
Publicado em: (2022)
por: Petmezas, Georgios
Publicado em: (2022)
school DeepRL-Based Motion Planning for Indoor Robot Navigation
por: Palaio, Daniel Silva
Publicado em: (2021)
por: Palaio, Daniel Silva
Publicado em: (2021)
article A trained Mask R-CNN model over PlanetScope imagery for very-high resolution surface water mapping in boreal forest-tundra
por: Freitas, Pedro
Publicado em: (2024)
por: Freitas, Pedro
Publicado em: (2024)
article Comparative study of autonomous production control methods using simulation
por: Martins, Luís Miguel
Publicado em: (2020)
por: Martins, Luís Miguel
Publicado em: (2020)
article A survey of simulation tools for cooperative positioning in autonomous vehicles
por: Silva, Ivo Miguel Menezes
Publicado em: (2024)
por: Silva, Ivo Miguel Menezes
Publicado em: (2024)
school DeepRL-based Context-aware Local Motion Planning for Mobile Robots
por: Mendes, Rodrigo Simões dos Santos Ferreira
Publicado em: (2024)
por: Mendes, Rodrigo Simões dos Santos Ferreira
Publicado em: (2024)
school Motion planning using DeepRL, applied to an industrial forklift pallet picking problem
por: Godinho, Francisco José Pessoa
Publicado em: (2025)
por: Godinho, Francisco José Pessoa
Publicado em: (2025)
article Enhancing rail defect detection: Comparative analysis of two-layer and five-layer CNN networks
por: Mohammadkhah, Saeed
Publicado em: (2024)
por: Mohammadkhah, Saeed
Publicado em: (2024)
article Deep learning methods for automatic evaluation of delayed enhancement-MRI. The results of the EMIDEC challenge
por: Lalande, Alain
Publicado em: (2022)
por: Lalande, Alain
Publicado em: (2022)
school IoT Edge Computing Neural Networks on Reconfigurable Logic
por: Barreto, Ricardo Manuel Carriço
Publicado em: (2019)
por: Barreto, Ricardo Manuel Carriço
Publicado em: (2019)
school Estimating Optical Flow using Convolutional Neural Networks in Reconfigurable Logic
por: Rodrigues, Rodrigo Pedrosa
Publicado em: (2020)
por: Rodrigues, Rodrigo Pedrosa
Publicado em: (2020)
article Recommendation system using reinforcement learning for what-If simulation in digital twin
por: Pires, Flávia
Publicado em: (2021)
por: Pires, Flávia
Publicado em: (2021)
article Carla Galvão: uma arquitecta das mágoas boas
por: Coelho, Rui Pina
Publicado em: (2009)
por: Coelho, Rui Pina
Publicado em: (2009)
article “Arresting Gaddafi Will Be the Most Effective Way to Stop these Rapes”. Sexual Violence in the Western Media’s Coverage of the War in Libya
por: Garraio, Júlia
Publicado em: (2012)
por: Garraio, Júlia
Publicado em: (2012)
school An approach to simulation of autonomous vehicles
por: Figueiredo, Miguel Cordeiro
Publicado em: (2009)
por: Figueiredo, Miguel Cordeiro
Publicado em: (2009)
school O Local do Nacional: a importância de uma redação regional numa televisão nacional – o caso da TVI/CNN Porto
por: Gonçalves, Hugo António Santos
Publicado em: (2025)
por: Gonçalves, Hugo António Santos
Publicado em: (2025)
article Secure management of autonomous vehicle platooning
por: Gonçalves, Fábio Raul Costa
Publicado em: (2018)
por: Gonçalves, Fábio Raul Costa
Publicado em: (2018)
article Simulation on Digital Twin: Role of Artificial Intelligence and Emergence of Industrial Metaverse
por: Oliveira Júnior, Alexandre de
Publicado em: (2024)
por: Oliveira Júnior, Alexandre de
Publicado em: (2024)
school Handwriting Rehabilitation Using a Haptic Joystick
por: Quaresma, Vasco Araújo Goulart
Publicado em: (2021)
por: Quaresma, Vasco Araújo Goulart
Publicado em: (2021)
school Treino Semiautomático de Sistema de Reconhecimento de Fonemas baseado em Redes Neuronais
por: Costa, David António Oliveira
Publicado em: (2018)
por: Costa, David António Oliveira
Publicado em: (2018)
article Intelligent traffic control strategies for VLC-connected vehicles and pedestrian flow management
por: Galvão, Gonçalo
Publicado em: (2025)
por: Galvão, Gonçalo
Publicado em: (2025)
school Deep Learning Applications in non-intrusive load monitoring
por: Gaimes, Yousra
Publicado em: (2022)
por: Gaimes, Yousra
Publicado em: (2022)
article Model to simulate the behaviour of RC beams shear strengthened with ETS bars
por: Barros, Joaquim A. O.
Publicado em: (2013)
por: Barros, Joaquim A. O.
Publicado em: (2013)
article An agent model for the simulation of electrical vehicle charging management
por: Monteiro, Vítor Duarte Fernandes
Publicado em: (2011)
por: Monteiro, Vítor Duarte Fernandes
Publicado em: (2011)
school Skeleton Fusion for Gestures Recognition in AugmentedReality Environments
por: Diogo, Miguel António de Figueiredo Moura
Publicado em: (2021)
por: Diogo, Miguel António de Figueiredo Moura
Publicado em: (2021)
article Novas vozes da literatura portuguesa para a infância : o caso de Carla Maia de Almeida
por: Silva, Sara Raquel Reis da
Publicado em: (2011)
por: Silva, Sara Raquel Reis da
Publicado em: (2011)
school Invariance and control of autonomous vehicles
por: Cardoso, Joana Isabel Lacerda da Fonseca Pinto
Publicado em: (2010)
por: Cardoso, Joana Isabel Lacerda da Fonseca Pinto
Publicado em: (2010)
Registos relacionados
-
article Adaptive Convolutional Neural Network for Predicting Steering Angle and Acceleration on Autonomous Driving Scenario
por: Vasiljević, Ive
Publicado em: (2024) -
article A Reinforcement Learning Assisted Eye-Driven Computer Game Employing a Decision Tree-Based Approach and CNN Classification
por: Perdiz, João
Publicado em: (2021) -
article GNSS simulation for automotive: introducing 3D scene-dependent multipath with CARLA
por: Pendão, Cristiano Gonçalves
Publicado em: (2025) -
article Comparative Analysis of Windows for Speech Emotion Recognition Using CNN
por: Teixeira, Felipe
Publicado em: (2024) -
school Realidades desvirtuadas: Entre o otimismo e o não-conformismo de Carla Filipe
por: Borges, Joana Oliveira
Publicado em: (2023)