Publicação
Resource-constrained onboard inference of 3D object detection and localisation in point clouds targeting self-driving applications
| Resumo: | Research about deep learning applied in object detection tasks in LiDAR data has been massively widespread in recent years, achieving notable developments, namely in improving precision and inference speed performances. These improvements have been facilitated by powerful GPU servers, taking advantage of their capacity to train the networks in reasonable periods and their parallel architecture that allows for high performance and real-time inference. However, these features are limited in autonomous driving due to space, power capacity, and inference time constraints, and onboard devices are not as powerful as their counterparts used for training. This paper investigates the use of a deep learning-based method in edge devices for onboard real-time inference that is power-effective and low in terms of space-constrained demand. A methodology is proposed for deploying high-end GPU-specific models in edge devices for onboard inference, consisting of a two-folder flow: study model hyperparameters’ implications in meeting application requirements; and compression of the network for meeting the board resource limitations. A hybrid FPGA-CPU board is proposed as an effective onboard inference solution by comparing its performance in the KITTI dataset with computer performances. The achieved accuracy is comparable to the PC-based deep learning method with a plus that it is more effective for real-time inference, power limited and space-constrained purposes. |
|---|---|
| Autores principais: | Silva, António José Linhares |
| Outros Autores: | Fernandes, Duarte; Névoa, Rafael Augusto Cunha Costinha; Monteiro, João L.; Novais, Paulo; Girão, Pedro; Afonso, Tiago; Melo-Pinto, Pedro |
| Assunto: | Autonomous driving Deep learning methods LiDAR scanners 3D object detection Onboard inference Quantisation methods |
| Ano: | 2021 |
| País: | Portugal |
| Tipo de documento: | artigo |
| Tipo de acesso: | acesso aberto |
| Instituição associada: | Universidade do Minho |
| Idioma: | inglês |
| Origem: | RepositóriUM - Universidade do Minho |
Registos relacionados
school All-digital ADC for an automotive LiDAR receiver
por: Cabete, Laura Figueiredo
Publicado em: (2022)
por: Cabete, Laura Figueiredo
Publicado em: (2022)
article Real-time 3D object detection and SLAM fusion in a low-cost LiDAR test vehicle setup
por: Fernandes, Duarte
Publicado em: (2021)
por: Fernandes, Duarte
Publicado em: (2021)
school Simplified 3D object detection for self-driving vehicles based on the removal of background points
por: Gomes, João Miguel Silva de Melo
Publicado em: (2021)
por: Gomes, João Miguel Silva de Melo
Publicado em: (2021)
school Next-generation 3D object detection and tracking for self-driving vehicles using object velocity
por: Mendonça, Diogo Emanuel Nascimento
Publicado em: (2023)
por: Mendonça, Diogo Emanuel Nascimento
Publicado em: (2023)
article A framework for representing, building and reusing novel atate-of-the-art three-dimensional object detection models in point clouds targeting self-driving applications
por: Silva, António José Linhares
Publicado em: (2023)
por: Silva, António José Linhares
Publicado em: (2023)
article Airborne laser scanning applied to eucalyptus stand inventory at individual tree level
por: Cosenza, Diogo Nepomuceno
Publicado em: (2018)
por: Cosenza, Diogo Nepomuceno
Publicado em: (2018)
school Laser systems for integrated LiDAR in autonomous vehicles
por: Rodrigues, Diogo Francisco de Almeida
Publicado em: (2023)
por: Rodrigues, Diogo Francisco de Almeida
Publicado em: (2023)
school Autopilot simulator prototype for autonomous driving based on SimTwo
por: Abreu, Adérito Daniel Mendes
Publicado em: (2020)
por: Abreu, Adérito Daniel Mendes
Publicado em: (2020)
school 3D object detection for autonomous driving using active stereoscopic vision with extended range
por: Dias, Renato Alexandre Lourenço
Publicado em: (2024)
por: Dias, Renato Alexandre Lourenço
Publicado em: (2024)
assignment Business plan windScanner.pt research infrastructure - national research infrastructure (PINFRA/22207/2016)
por: Grosso, José
Publicado em: (2021)
por: Grosso, José
Publicado em: (2021)
assignment Governance windscanner.PT national research infrastructure (PINFRA/22207/2016)
por: Grosso, José
Publicado em: (2021)
por: Grosso, José
Publicado em: (2021)
assignment Windscanner.PT: National Research Infrastructure
por: Simões, Teresa
Publicado em: (2021)
por: Simões, Teresa
Publicado em: (2021)
assignment Governance: WindScanner.PT
por: Grosso, José
Publicado em: (2021)
por: Grosso, José
Publicado em: (2021)
school Object identification for autonomous vehicles based on machine learning
por: Guedes, Diogo Alexandre Amaral Conde
Publicado em: (2021)
por: Guedes, Diogo Alexandre Amaral Conde
Publicado em: (2021)
school Interference analysis in time of flight LiDARs
por: Martins, Pedro Miguel Simões Bastos
Publicado em: (2019)
por: Martins, Pedro Miguel Simões Bastos
Publicado em: (2019)
school 3D object detection for self-driving vehicles aided by object velocity
por: Alexandrino, Leandro Miguel Ferreira
Publicado em: (2022)
por: Alexandrino, Leandro Miguel Ferreira
Publicado em: (2022)
article Point-cloud based 3D object detection and classification methods for self-driving applications: A survey and taxonomy
por: Fernandes, Duarte
Publicado em: (2021)
por: Fernandes, Duarte
Publicado em: (2021)
article Improving 3D Vulnerable Road User Detection With Point Augmentation
por: Lu, Weihao
Publicado em: (2023)
por: Lu, Weihao
Publicado em: (2023)
article The LiDAR hop-on-hop-off route: visiting the LiDARs past, present, and future landscapes
por: Nunes-Pereira, E. J.
Publicado em: (2019)
por: Nunes-Pereira, E. J.
Publicado em: (2019)
article A survey on data compression techniques for automotive LiDAR point clouds
por: Roriz, Ricardo João Rei
Publicado em: (2024)
por: Roriz, Ricardo João Rei
Publicado em: (2024)
school Suitability of an automotive LiDAR based on active stereo for 3D object detection
por: Graça, Roberto Oliveira
Publicado em: (2023)
por: Graça, Roberto Oliveira
Publicado em: (2023)
school Estimação do volume de um espaço interior com LiDAR
por: Bierende, Jaqueline
Publicado em: (2022)
por: Bierende, Jaqueline
Publicado em: (2022)
school Sistema de reconstrução 3D com LiDAR e câmara de espetro visível para veículo autónomo aéreo
por: Silva, Pedro André Peixoto Fonseca de Castro e
Publicado em: (2020)
por: Silva, Pedro André Peixoto Fonseca de Castro e
Publicado em: (2020)
article Automotive LiDAR technology: a survey
por: Roriz, Ricardo João Rei
Publicado em: (2022)
por: Roriz, Ricardo João Rei
Publicado em: (2022)
school Automotive LiDAR based on active stereoscopy with extended range
por: Rodrigues, Gonçalo Oliveira
Publicado em: (2024)
por: Rodrigues, Gonçalo Oliveira
Publicado em: (2024)
school Impact of calibration in a LiDAR based on stereoscopic vision
por: Alegria, João Jesus de Sousa
Publicado em: (2022)
por: Alegria, João Jesus de Sousa
Publicado em: (2022)
school Polarimetric LiDAR for target characterization aiming at autonomous driving implementations
por: Fernandes, Pedro Francisco Santos Braga
Publicado em: (2020)
por: Fernandes, Pedro Francisco Santos Braga
Publicado em: (2020)
school ADC and TDC-based front-ends for LiDAR
por: Brandão, Alexandre David
Publicado em: (2021)
por: Brandão, Alexandre David
Publicado em: (2021)
article Quality control of outsourced LiDAR data acquired with a UAV : a case study
por: Pereira, Luísa Gomes
Publicado em: (2021)
por: Pereira, Luísa Gomes
Publicado em: (2021)
article Volume estimation of an indoor space with LiDAR scanner
por: Bierende, Jaqueline
Publicado em: (2023)
por: Bierende, Jaqueline
Publicado em: (2023)
article Quality Control of Outsourced LiDAR Data Acquired with a UAV: A Case Study
por: Pereira, Luísa Gomes
Publicado em: (2021)
por: Pereira, Luísa Gomes
Publicado em: (2021)
school LiDAR-based Topological Mapping of Orchard Environments
por: Teixeira, André de Sousa Nunes
Publicado em: (2022)
por: Teixeira, André de Sousa Nunes
Publicado em: (2022)
school Detection of Power Line Supporting Towers via Interpretable Semantic Segmentation of 3D Point Clouds
por: Lavado, Diogo Restolho Mateus Marçalo
Publicado em: (2022)
por: Lavado, Diogo Restolho Mateus Marçalo
Publicado em: (2022)
school LiDAR based 3D object tracking for autonomous driving
por: Figueiredo, André Sousa
Publicado em: (2022)
por: Figueiredo, André Sousa
Publicado em: (2022)
school Aquisição de dados LiDAR com TLS e HMLS para deteção de árvores individuais
por: Rascão, Madalena da Silva Ruivo Coreixas
Publicado em: (2019)
por: Rascão, Madalena da Silva Ruivo Coreixas
Publicado em: (2019)
school Evaluation of data augmentation techniques in 3D object detection for self-driving vehicles
por: Santos, Xavier Pinto
Publicado em: (2021)
por: Santos, Xavier Pinto
Publicado em: (2021)
article Hardware-accelerated data decoding and reconstruction for automotive LiDAR sensors
por: Cunha, Luis
Publicado em: (2023)
por: Cunha, Luis
Publicado em: (2023)
school Benchmark aplicado à Deteção de Objetos de Mamoas Arqueológicas a partir de dados LiDAR
por: Silva, Miguel Ribeiro Vilar Brás da
Publicado em: (2023)
por: Silva, Miguel Ribeiro Vilar Brás da
Publicado em: (2023)
article Development of a Low-Cost 3D Mapping Technology with 2D LIDAR for Path Planning Based on the A* Algorithm
por: Ferreira, Edilson Santos
Publicado em: (2024)
por: Ferreira, Edilson Santos
Publicado em: (2024)
book Land Cover mapping by combining GEDI-derived vertical metrics with SAR and multispectral data
por: Godinho, Sérgio
Publicado em: (2026)
por: Godinho, Sérgio
Publicado em: (2026)
Registos relacionados
-
school All-digital ADC for an automotive LiDAR receiver
por: Cabete, Laura Figueiredo
Publicado em: (2022) -
article Real-time 3D object detection and SLAM fusion in a low-cost LiDAR test vehicle setup
por: Fernandes, Duarte
Publicado em: (2021) -
school Simplified 3D object detection for self-driving vehicles based on the removal of background points
por: Gomes, João Miguel Silva de Melo
Publicado em: (2021) -
school Next-generation 3D object detection and tracking for self-driving vehicles using object velocity
por: Mendonça, Diogo Emanuel Nascimento
Publicado em: (2023) -
article A framework for representing, building and reusing novel atate-of-the-art three-dimensional object detection models in point clouds targeting self-driving applications
por: Silva, António José Linhares
Publicado em: (2023)