scholarly journals Degeneration-Aware Localization with Arbitrary Global-Local Sensor Fusion

Sensors ◽  
2021 ◽  
Vol 21 (12) ◽  
pp. 4042
Author(s):  
Xiaqing Ding ◽  
Fuzhang Han ◽  
Tong Yang ◽  
Yue Wang ◽  
Rong Xiong
Keyword(s):  
Sensor Fusion ◽  
Single Type ◽  
Fusion Method ◽  
Global Localization ◽  
Related System ◽  
Multiple Sensors ◽  
Fusion Methods ◽  
Local Reference ◽  
Real World Datasets ◽  
Global And Local

Global localization is a fundamental ability for mobile robots. Considering the limitation of single type of sensor, fusing measurements from multiple sensors with complementary properties is a valuable task for study. In this paper, we propose a decoupled optimization-based framework for global–local sensor fusion, which fuses the intermittent 3D global positions and high-frequent 6D odometry poses to infer the 6D global localization results in real-time. The fusion process is formulated as estimating the relative transformation between global and local reference coordinates, translational extrinsic calibration, and the scale of the local pose estimator. We validate the full observability of the system under general movements, and further analyze the degenerated movement patterns where some related system state would be unobservable. A degeneration-aware sensor fusion method is designed which detects the degenerated directions before optimization, and adds constraints specifically along these directions to relieve the effect of the noise. The proposed degeneration-aware global–local sensor fusion method is validated in both simulation and real-world datasets with different sensor configurations, and shows its effectiveness in terms of accuracy and robustness compared with other decoupled sensor fusion methods for global localization.

scholarly journals Train Localization using Unscented Kalman Filter – Based Sensor Fusion

2018 ◽  
Vol 1 (2) ◽  
pp. 35-41
Author(s):  
I Faruqi ◽  
M. B. Waluya ◽  
Y. Y. Nazaruddin ◽  
T. A. Tamba ◽  
◽  
...  
Keyword(s):  
Kalman Filter ◽  
Sensor Fusion ◽  
Precision Measurement ◽  
Unscented Kalman Filter ◽  
Measurement Data ◽  
Experimental Results ◽  
Fusion Method ◽  
Localization Problem ◽  
Rail Systems ◽  
Fusion Methods

This paper presents an application of sensor fusion methods based on Unscented Kalman filter (UKF) technique for solving train localization problem in rail systems. The paper first reports the development of a laboratory-scale rail system simulator which is equipped with various onboard and wayside sensors that are used to detect and locate the train vehicle movements in the rail track. Due to the low precision measurement data obtained by each individual sensor, a sensor fusion method based on the UKF technique is implemented to fuse the measurement data from several sensors. Experimental results which demonstrate the effectiveness of the proposed UKF-based sensor fusion method for solving the train localization problem is also reported.

scholarly journals Multi-Sensor Fusion for Activity Recognition—A Survey

Sensors ◽  
2019 ◽  
Vol 19 (17) ◽  
pp. 3808 ◽  
Author(s):  
Antonio A. Aguileta ◽  
Ramon F. Brena ◽  
Oscar Mayora ◽  
Erik Molino-Minero-Re ◽  
Luis A. Trejo
Keyword(s):  
Sensor Fusion ◽  
Activity Recognition ◽  
Sports Medicine ◽  
Good Practice ◽  
Sensor Data ◽  
Personal Safety ◽  
Multiple Sensors ◽  
Concurrent Use ◽  
Fusion Methods ◽  
The Many

In Ambient Intelligence (AmI), the activity a user is engaged in is an essential part of the context, so its recognition is of paramount importance for applications in areas like sports, medicine, personal safety, and so forth. The concurrent use of multiple sensors for recognition of human activities in AmI is a good practice because the information missed by one sensor can sometimes be provided by the others and many works have shown an accuracy improvement compared to single sensors. However, there are many different ways of integrating the information of each sensor and almost every author reporting sensor fusion for activity recognition uses a different variant or combination of fusion methods, so the need for clear guidelines and generalizations in sensor data integration seems evident. In this survey we review, following a classification, the many fusion methods for information acquired from sensors that have been proposed in the literature for activity recognition; we examine their relative merits, either as they are reported and sometimes even replicated and a comparison of these methods is made, as well as an assessment of the trends in the area.

scholarly journals Centralised and Decentralised Sensor Fusion-Based Emergency Brake Assist

Sensors ◽  
2021 ◽  
Vol 21 (16) ◽  
pp. 5422
Author(s):  
Ankur Deo ◽  
Vasile Palade ◽  
Md. Nazmul Huda
Keyword(s):  
Sensor Fusion ◽  
Computational Cost ◽  
Environmental Parameters ◽  
Frame Rate ◽  
Driver Assistance ◽  
Driver Assistance Systems ◽  
Fusion Algorithm ◽  
Multiple Sensors ◽  
Fusion Methods ◽  
Brake Assist

Many advanced driver assistance systems (ADAS) are currently trying to utilise multi-sensor architectures, where the driver assistance algorithm receives data from a multitude of sensors. As mono-sensor systems cannot provide reliable and consistent readings under all circumstances because of errors and other limitations, fusing data from multiple sensors ensures that the environmental parameters are perceived correctly and reliably for most scenarios, thereby substantially improving the reliability of the multi-sensor-based automotive systems. This paper first highlights the significance of efficiently fusing data from multiple sensors in ADAS features. An emergency brake assist (EBA) system is showcased using multiple sensors, namely, a light detection and ranging (LiDAR) sensor and camera. The architectures of the proposed ‘centralised’ and ‘decentralised’ sensor fusion approaches for EBA are discussed along with their constituents, i.e., the detection algorithms, the fusion algorithm, and the tracking algorithm. The centralised and decentralised architectures are built and analytically compared, and the performance of these two fusion architectures for EBA are evaluated in terms of speed of execution, accuracy, and computational cost. While both fusion methods are seen to drive the EBA application at an acceptable frame rate (~20fps or higher) on an Intel i5-based Ubuntu system, it was concluded through the experiments and analytical comparisons that the decentralised fusion-driven EBA leads to higher accuracy; however, it has the downside of a higher computational cost. The centralised fusion-driven EBA yields comparatively less accurate results, but with the benefits of a higher frame rate and lesser computational cost.

scholarly journals Choosing the Best Sensor Fusion Method: A Machine-Learning Approach

Sensors ◽  
2020 ◽  
Vol 20 (8) ◽  
pp. 2350 ◽  
Author(s):  
Ramon F. Brena ◽  
Antonio A. Aguileta ◽  
Luis A. Trejo ◽  
Erik Molino-Minero-Re ◽  
Oscar Mayora
Keyword(s):  
Machine Learning ◽  
Sensor Fusion ◽  
Data Sets ◽  
Extended Model ◽  
Fusion Method ◽  
Data Set ◽  
Face Expression ◽  
Machine Learning Approach ◽  
Fusion Methods ◽  
Data Driven Approach

Multi-sensor fusion refers to methods used for combining information coming from several sensors (in some cases, different ones) with the aim to make one sensor compensate for the weaknesses of others or to improve the overall accuracy or the reliability of a decision-making process. Indeed, this area has made progress, and the combined use of several sensors has been so successful that many authors proposed variants of fusion methods, to the point that it is now hard to tell which of them is the best for a given set of sensors and a given application context. To address the issue of choosing an adequate fusion method, we recently proposed a machine-learning data-driven approach able to predict the best merging strategy. This approach uses a meta-data set with the Statistical signatures extracted from data sets of a particular domain, from which we train a prediction model. However, the mentioned work is restricted to the recognition of human activities. In this paper, we propose to extend our previous work to other very different contexts, such as gas detection and grammatical face expression identification, in order to test its generality. The extensions of the method are presented in this paper. Our experimental results show that our extended model predicts the best fusion method well for a given data set, making us able to claim a broad generality for our sensor fusion method.

scholarly journals Gas Detection and Identification Using Multimodal Artificial Intelligence Based Sensor Fusion

2021 ◽  
Vol 4 (1) ◽  
pp. 3
Author(s):  
Parag Narkhede ◽  
Rahee Walambe ◽  
Shruti Mandaokar ◽  
Pulkit Chandel ◽  
Ketan Kotecha ◽  
...  
Keyword(s):  
Sensor Fusion ◽  
Network Architecture ◽  
Cost Effective ◽  
Sensor Data ◽  
Dense Layer ◽  
Gaseous Emissions ◽  
Multiple Sensors ◽  
Single Output ◽  
Novel Approach ◽  
Single Sensor

With the rapid industrialization and technological advancements, innovative engineering technologies which are cost effective, faster and easier to implement are essential. One such area of concern is the rising number of accidents happening due to gas leaks at coal mines, chemical industries, home appliances etc. In this paper we propose a novel approach to detect and identify the gaseous emissions using the multimodal AI fusion techniques. Most of the gases and their fumes are colorless, odorless, and tasteless, thereby challenging our normal human senses. Sensing based on a single sensor may not be accurate, and sensor fusion is essential for robust and reliable detection in several real-world applications. We manually collected 6400 gas samples (1600 samples per class for four classes) using two specific sensors: the 7-semiconductor gas sensors array, and a thermal camera. The early fusion method of multimodal AI, is applied The network architecture consists of a feature extraction module for individual modality, which is then fused using a merged layer followed by a dense layer, which provides a single output for identifying the gas. We obtained the testing accuracy of 96% (for fused model) as opposed to individual model accuracies of 82% (based on Gas Sensor data using LSTM) and 93% (based on thermal images data using CNN model). Results demonstrate that the fusion of multiple sensors and modalities outperforms the outcome of a single sensor.

scholarly journals Sensor Fusion for Recognition of Activities of Daily Living

Sensors ◽  
2018 ◽  
Vol 18 (11) ◽  
pp. 4029 ◽  
Author(s):  
Jiaxuan Wu ◽  
Yunfei Feng ◽  
Peng Sun
Keyword(s):  
Time Series ◽  
Sensor Fusion ◽  
Daily Living ◽  
Single Point ◽  
Recognition System ◽  
Sensor Data ◽  
Multiple Sensors ◽  
Life Patterns ◽  
Functional Capabilities ◽  
Correction Technique

Activity of daily living (ADL) is a significant predictor of the independence and functional capabilities of an individual. Measurements of ADLs help to indicate one’s health status and capabilities of quality living. Recently, the most common ways to capture ADL data are far from automation, including a costly 24/7 observation by a designated caregiver, self-reporting by the user laboriously, or filling out a written ADL survey. Fortunately, ubiquitous sensors exist in our surroundings and on electronic devices in the Internet of Things (IoT) era. We proposed the ADL Recognition System that utilizes the sensor data from a single point of contact, such as smartphones, and conducts time-series sensor fusion processing. Raw data is collected from the ADL Recorder App constantly running on a user’s smartphone with multiple embedded sensors, including the microphone, Wi-Fi scan module, heading orientation of the device, light proximity, step detector, accelerometer, gyroscope, magnetometer, etc. Key technologies in this research cover audio processing, Wi-Fi indoor positioning, proximity sensing localization, and time-series sensor data fusion. By merging the information of multiple sensors, with a time-series error correction technique, the ADL Recognition System is able to accurately profile a person’s ADLs and discover his life patterns. This paper is particularly concerned with the care for the older adults who live independently.

scholarly journals IMAGE-BASED ORIENTATION DETERMINATION OF MOBILE SENSOR PLATFORMS

2021 ◽  
Vol XLIII-B1-2021 ◽  
pp. 215-220
Author(s):  
O. Hasler ◽  
S. Nebiker
Keyword(s):  
Sensor Fusion ◽  
Pose Estimation ◽  
Reference System ◽  
Laser Scanner ◽  
Relative Orientation ◽  
Robotic Platform ◽  
Sensor Platforms ◽  
Local Reference ◽  
The Absolute ◽  
Additional Approach

Abstract. Estimating the pose of a mobile robotic platform is a challenging task, especially when the pose needs to be estimated in a global or local reference frame and when the estimation has to be performed while the platform is moving. While the position of a platform can be measured directly via modern tachymetry or with the help of a global positioning service GNSS, the absolute platform orientation is harder to derive. Most often, only the relative orientation is estimated with the help of a sensor mounted on the robotic platform such as an IMU, with one or multiple cameras, with a laser scanner or with a combination of any of those. Then, a sensor fusion of the relative orientation and the absolute position is performed. In this work, an additional approach is presented: first, an image-based relative pose estimation with frames from a panoramic camera using a state-of-the-art visual odometry implementation is performed. Secondly, the position of the platform in a reference system is estimated using motorized tachymetry. Lastly, the absolute orientation is calculated using a visual marker, which is placed in the space, where the robotic platform is moving. The marker can be detected in the camera frame and since the position of this marker is known in the reference system, the absolute pose can be estimated. To improve the absolute pose estimation, a sensor fusion is conducted. Results with a Lego model train as a mobile platform show, that the trajectory of the absolute pose calculated independently with four different markers have a deviation < 0.66 degrees 50% of the time and that the average difference is < 1.17 degrees. The implementation is based on the popular Robotic Operating System ROS.

scholarly journals Vehicle Trajectory Estimation Based on Fusion of Visual Motion Features and Deep Learning

Sensors ◽  
2021 ◽  
Vol 21 (23) ◽  
pp. 7969
Author(s):  
Lianen Qu ◽  
Matthew N. Dailey
Keyword(s):  
Neural Networks ◽  
Optical Flow ◽  
Convolutional Neural Networks ◽  
Situation Awareness ◽  
Visual Motion ◽  
Accurate Method ◽  
Estimation Methods ◽  
Single Type ◽  
Global Localization ◽  
Trajectory Estimation

Driver situation awareness is critical for safety. In this paper, we propose a fast, accurate method for obtaining real-time situation awareness using a single type of sensor: monocular cameras. The system tracks the host vehicle’s trajectory using sparse optical flow and tracks vehicles in the surrounding environment using convolutional neural networks. Optical flow is used to measure the linear and angular velocity of the host vehicle. The convolutional neural networks are used to measure target vehicles’ positions relative to the host vehicle using image-based detections. Finally, the system fuses host and target vehicle trajectories in the world coordinate system using the velocity of the host vehicle and the target vehicles’ relative positions with the aid of an Extended Kalman Filter (EKF). We implement and test our model quantitatively in simulation and qualitatively on real-world test video. The results show that the algorithm is superior to state-of-the-art sequential state estimation methods such as visual SLAM in performing accurate global localization and trajectory estimation for host and target vehicles.

Sign in / Sign up

Export Citation Format

Share Document