Document details

Resource-constrained onboard inference of 3D object detection and localisation in point clouds targeting self-driving applications

Author(s): Silva, António José Linhares ; Fernandes, Duarte ; Névoa, Rafael Augusto Cunha Costinha ; Monteiro, João L. ; Novais, Paulo ; Girão, Pedro ; Afonso, Tiago ; Melo-Pinto, Pedro

Date: 2021

Persistent ID: https://hdl.handle.net/1822/76714

Origin: RepositóriUM - Universidade do Minho

Subject(s): Autonomous driving; Deep learning methods; LiDAR scanners; 3D object detection; Onboard inference; Quantisation methods


Description

Research about deep learning applied in object detection tasks in LiDAR data has been massively widespread in recent years, achieving notable developments, namely in improving precision and inference speed performances. These improvements have been facilitated by powerful GPU servers, taking advantage of their capacity to train the networks in reasonable periods and their parallel architecture that allows for high performance and real-time inference. However, these features are limited in autonomous driving due to space, power capacity, and inference time constraints, and onboard devices are not as powerful as their counterparts used for training. This paper investigates the use of a deep learning-based method in edge devices for onboard real-time inference that is power-effective and low in terms of space-constrained demand. A methodology is proposed for deploying high-end GPU-specific models in edge devices for onboard inference, consisting of a two-folder flow: study model hyperparameters’ implications in meeting application requirements; and compression of the network for meeting the board resource limitations. A hybrid FPGA-CPU board is proposed as an effective onboard inference solution by comparing its performance in the KITTI dataset with computer performances. The achieved accuracy is comparable to the PC-based deep learning method with a plus that it is more effective for real-time inference, power limited and space-constrained purposes.

Document Type Journal article
Language English
Contributor(s) RepositóriUM - Universidade do Minho
CC Licence
facebook logo  linkedin logo  twitter logo 
mendeley logo

Related documents

No related documents