scholarly journals Semantic Evidential Grid Mapping Using Monocular and Stereo Cameras

Sensors ◽  
2021 ◽  
Vol 21 (10) ◽  
pp. 3380
Author(s):  
Sven Richter ◽  
Yiqun Wang ◽  
Johannes Beck ◽  
Sascha Wirges ◽  
Christoph Stiller

Accurately estimating the current state of local traffic scenes is one of the key problems in the development of software components for automated vehicles. In addition to details on free space and drivability, static and dynamic traffic participants and information on the semantics may also be included in the desired representation. Multi-layer grid maps allow the inclusion of all of this information in a common representation. However, most existing grid mapping approaches only process range sensor measurements such as Lidar and Radar and solely model occupancy without semantic states. In order to add sensor redundancy and diversity, it is desired to add vision-based sensor setups in a common grid map representation. In this work, we present a semantic evidential grid mapping pipeline, including estimates for eight semantic classes, that is designed for straightforward fusion with range sensor data. Unlike other publications, our representation explicitly models uncertainties in the evidential model. We present results of our grid mapping pipeline based on a monocular vision setup and a stereo vision setup. Our mapping results are accurate and dense mapping due to the incorporation of a disparity- or depth-based ground surface estimation in the inverse perspective mapping. We conclude this paper by providing a detailed quantitative evaluation based on real traffic scenarios in the KITTI odometry benchmark dataset and demonstrating the advantages compared to other semantic grid mapping approaches.

Author(s):  
Sven Richter ◽  
Yiqun Wang ◽  
Johannes Beck ◽  
Sascha Wirges ◽  
Christoph Stiller

Accurately estimating the current state of local traffic scenes is one of the key problems in the development of software components for automated vehicles. In addition to details on free space and drivability, static and dynamic traffic participants, information on the semantics may also be included in the desired representation. Multi-layer grid maps allow to include all this information in a common representation. However, most existing grid mapping approaches only process range sensor measurements such as LIDAR and Radar and solely model occupancy without semantic states. In order to add sensor redundancy and diversity it is desired to add vision based sensor setups in a common grid map representation. In this work, we present a semantic evidential grid mapping pipeline including estimates for eight semantic classes that is designed for straightforward fusion with range sensor data. Unlike in other publication our representation explicitly models uncertainties in the evdiential model. We present results of our grid mapping pipeline based on a monocular vision setup and a stereo vision setup. Our mapping resulsts are accurate and dense mapping due to the incorporation of a disparity- or depth-based ground surface estimation in the inverse perspective mapping. We conclude this paper by providing a detailed quantitative evaluation based on real traffic scenarios in the Kitti odometry benchmark and demonstrating the advantages compared to other semantic grid mapping approaches.


2016 ◽  
Vol 693 ◽  
pp. 1397-1404 ◽  
Author(s):  
Qi Long Wang ◽  
Jian Yong Li ◽  
Hai Kuo Shen ◽  
Teng Teng Song ◽  
Yan Xuan Ma

The system of binocular vision sensor was used in the air-to-air close air target positioning in the paper. Due to the limitation of model itself, the measurement accuracy along the direction of optical axis is far lower than the accuracy of vertical direction. In order to improve the measurement accuracy of the optical axis, the paper put forward to using laser range sensor to cooperate with binocular vision sensor; Then the paper proposed adopts adaptive weighted fusion algorithm of multi-sensor information fusion to improve the utilization efficiency of multi-sensor information and to make the results accurately; Finally, the parameters of the system were calibration respectively and experiment is simulated, experimental results show that the position system is feasibility and effectiveness.


Author(s):  
Meisong Wang ◽  
Charith Perera ◽  
Prem Prakash Jayaraman ◽  
Miranda Zhang ◽  
Peter Strazdins ◽  
...  

Internet of Things (IoT) has gained substantial attention recently and play a significant role in smart city application deployments. A number of such smart city applications depend on sensor fusion capabilities in the cloud from diverse data sources. The authors introduce the concept of IoT and present in detail ten different parameters that govern our sensor data fusion evaluation framework. They then evaluate the current state-of-the art in sensor data fusion against our sensor data fusion framework. The authors' main goal is to examine and survey different sensor data fusion research efforts based on our evaluation framework. The major open research issues related to sensor data fusion are also presented.


Author(s):  
MICHAEL N. HUHNS

This paper describes a new approach to the production of robust software. We first motivate the approach by explaining why the two major goals of software engineering — correct software and reusable software — are not being addressed by the current state of software practice. We then describe a methodology based on active, cooperative, and persistent software components, i.e., agents, and show how the methodology produces robust and reusable software. We derive requirements for the structure and behavior of the agents, and report on preliminary experiments on applications based on the methodology. We conclude with a roadmap for development of the methodology and ruminations about uses for the new computational paradigm.


Author(s):  
Adnan Rafi Al Tahtawi

In the control system application, the existence of noise measurement may impact on the performance degradation. The noise measurement of the sensor is produced due to several reasons, such as the low specification, external signal disturbances, and the complexity of measured state. Therefore, it should be avoided to achieve the good control performance. One of the solutions is by designing a signal filter. In this paper, the design of Kalman Filter (KF) algorithm for ultrasonic range sensor is presented. KF algorithm is designed to overcome the existence of noise measurement on the sensor. The type of ultrasonic range sensor used is HC-SR04 which is capable to detect the distance from 2 cm to 400 cm. The discrete KF algorithm is implemented using ATMega 328p microcontroller on Arduino Uno board. The algorithm is then tested with different three covariance values of process noise. The test result shows that the KF algorithm is able to reduce the measurement noise of the ultrasonic sensor. The analysis of variance conducted shows that the smaller value of covariance matrix of the process and measured noises, the better filtering process performed. However, this results in a longer generated response time. Thus, an optimization is required to obtain the best filtering performance.


2017 ◽  
pp. 398-422 ◽  
Author(s):  
Meisong Wang ◽  
Charith Perera ◽  
Prem Prakash Jayaraman ◽  
Miranda Zhang ◽  
Peter Strazdins ◽  
...  

Internet of Things (IoT) has gained substantial attention recently and play a significant role in smart city application deployments. A number of such smart city applications depend on sensor fusion capabilities in the cloud from diverse data sources. The authors introduce the concept of IoT and present in detail ten different parameters that govern our sensor data fusion evaluation framework. They then evaluate the current state-of-the art in sensor data fusion against our sensor data fusion framework. The authors' main goal is to examine and survey different sensor data fusion research efforts based on our evaluation framework. The major open research issues related to sensor data fusion are also presented.


2007 ◽  
Vol 39 (3) ◽  
pp. 224-240 ◽  
Author(s):  
Christina Staudhammer ◽  
Thomas C. Maness ◽  
Robert A. Kozak
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document