Semi-Direct Monocular Visual-Inertial Odometry Using Point and Line Features for IoV

2022 ◽  
Vol 22 (1) ◽  
pp. 1-23
Author(s):  
Nan Jiang ◽  
Debin Huang ◽  
Jing Chen ◽  
Jie Wen ◽  
Heng Zhang ◽  
...  

The precise measuring of vehicle location has been a critical task in enhancing the autonomous driving in terms of intelligent decision making and safe transportation. Internet of Vehicles ( IoV ) is an important infrastructure in support of autonomous driving, allowing real-time road information exchanging and sharing for localizing vehicles. Global positioning System ( GPS ) is widely used in the traditional IoV system. GPS is unable to meet the key application requirements of autonomous driving due to meter level error and signal deterioration. In this article, we propose a novel solution, named Semi-Direct Monocular Visual-Inertial Odometry using Point and Line Features ( SDMPL-VIO ) for precise vehicle localization. Our SDMPL-VIO model takes advantage of a low-cost Inertial Measurement Unit ( IMU ) and monocular camera, using them as the sensor to acquire the surrounding environmental information. Visual-Inertial Odometry ( VIO ), taking into account both point and line features, is proposed, which is able to deal with both weak texture and dynamic environment. We use a semi-direct method to deal with keyframes and non-keyframes, respectively. Dual sliding window mechanisms can effectively fuse point-line and IMU information. To evaluate our SDMPL-VIO system model, we conduct extensive experiments on both an indoor dataset (i.e., EuRoC) and an outdoor dataset (i.e., KITTI) from the real-world applications, respectively. The experimental results show that the accuracy of SDMPL-VIO proposed by us is better than the mainstream VIO system at present. Especially in the weak texture of the datasets, fast-moving datasets, and other challenging datasets, SDMPL-VIO has a relatively high robustness.

Sensors ◽  
2018 ◽  
Vol 18 (10) ◽  
pp. 3270 ◽  
Author(s):  
Hao Cai ◽  
Zhaozheng Hu ◽  
Gang Huang ◽  
Dunyao Zhu ◽  
Xiaocong Su

Self-localization is a crucial task for intelligent vehicles. Existing localization methods usually require high-cost IMU (Inertial Measurement Unit) or expensive LiDAR sensors (e.g., Velodyne HDL-64E). In this paper, we propose a low-cost yet accurate localization solution by using a custom-level GPS receiver and a low-cost camera with the support of HD map. Unlike existing HD map-based methods, which usually requires unique landmarks within the sensed range, the proposed method utilizes common lane lines for vehicle localization by using Kalman filter to fuse the GPS, monocular vision, and HD map for more accurate vehicle localization. In the Kalman filter framework, the observations consist of two parts. One is the raw GPS coordinate. The other is the lateral distance between the vehicle and the lane, which is computed from the monocular camera. The HD map plays the role of providing reference position information and correlating the local lateral distance from the vision and the GPS coordinates so as to formulate a linear Kalman filter. In the prediction step, we propose using a data-driven motion model rather than a Kinematic model, which is more adaptive and flexible. The proposed method has been tested with both simulation data and real data collected in the field. The results demonstrate that the localization errors from the proposed method are less than half or even one-third of the original GPS positioning errors by using low cost sensors with HD map support. Experimental results also demonstrate that the integration of the proposed method into existing ones can greatly enhance the localization results.


Author(s):  
Erliang Yao ◽  
Hexin Zhang ◽  
Haitao Song ◽  
Guoliang Zhang

Purpose To realize stable and precise localization in the dynamic environments, the authors propose a fast and robust visual odometry (VO) approach with a low-cost Inertial Measurement Unit (IMU) in this study. Design/methodology/approach The proposed VO incorporates the direct method with the indirect method to track the features and to optimize the camera pose. It initializes the positions of tracked pixels with the IMU information. Besides, the tracked pixels are refined by minimizing the photometric errors. Due to the small convergence radius of the indirect method, the dynamic pixels are rejected. Subsequently, the camera pose is optimized by minimizing the reprojection errors. The frames with little dynamic information are selected to create keyframes. Finally, the local bundle adjustment is performed to refine the poses of the keyframes and the positions of 3-D points. Findings The proposed VO approach is evaluated experimentally in dynamic environments with various motion types, suggesting that the proposed approach achieves more accurate and stable location than the conventional approach. Moreover, the proposed VO approach works well in the environments with the motion blur. Originality/value The proposed approach fuses the indirect method and the direct method with the IMU information, which improves the localization in dynamic environments significantly.


Drones ◽  
2022 ◽  
Vol 6 (1) ◽  
pp. 23
Author(s):  
Tong Zhang ◽  
Chunjiang Liu ◽  
Jiaqi Li ◽  
Minghui Pang ◽  
Mingang Wang

In view of traditional point-line feature visual inertial simultaneous localization and mapping (SLAM) system, which has weak performance in accuracy so that it cannot be processed in real time under the condition of weak indoor texture and light and shade change, this paper proposes an inertial SLAM method based on point-line vision for indoor weak texture and illumination. Firstly, based on Bilateral Filtering, we apply the Speeded Up Robust Features (SURF) point feature extraction and Fast Nearest neighbor (FLANN) algorithms to improve the robustness of point feature extraction result. Secondly, we establish a minimum density threshold and length suppression parameter selection strategy of line feature, and take the geometric constraint line feature matching into consideration to improve the efficiency of processing line feature. And the parameters and biases of visual inertia are initialized based on maximum posterior estimation method. Finally, the simulation experiments are compared with the traditional tightly-coupled monocular visual–inertial odometry using point and line features (PL-VIO) algorithm. The simulation results demonstrate that the proposed an inertial SLAM method based on point-line vision for indoor weak texture and illumination can be effectively operated in real time, and its positioning accuracy is 22% higher on average and 40% higher in the scenario that illumination changes and blurred image.


Sensors ◽  
2017 ◽  
Vol 17 (10) ◽  
pp. 2359 ◽  
Author(s):  
Rafael Vivacqua ◽  
Raquel Vassallo ◽  
Felipe Martins

2012 ◽  
Vol 157-158 ◽  
pp. 62-65
Author(s):  
Lin Zhao ◽  
Yong Hao ◽  
Li Shu Guo

A GPS signal tracking method utilizing optimized processing in inertial measurement unit (IMU) aided GPS receiver is studied. In order to enhance the sensitivity of baseband processing, low-cost inertial sensors are applied in the GPS and strapdown inertial navigation system (SINS) integration commonly, where the estimation accuracy of Doppler frequency would influence the whole performance of the tracking loops. Stochastic errors of carrier Doppler estimation caused by inertial sensors and local oscillators are corrected utilizing auto regressive moving average (ARMA) method in this paper. And then the accuracy Doppler information is used to correct the local code phase and local carrier frequency to further determine the search space of frequency domain which is unlike to the design of traditional aided loop. Simulation results indicate that the bandwidth of carrier loop and code loop could be decreased significantly in high dynamic environment.


2015 ◽  
Vol 03 (04) ◽  
pp. 239-251 ◽  
Author(s):  
Wenjie Lu ◽  
Sergio A. Rodríguez F. ◽  
Emmanuel Seignez ◽  
Roger Reynaud

Autonomous Vehicle applications and Advanced Driving Assistance Systems (ADAS) need scene understanding processes, allowing high-level systems to carry out decision. For such systems, the localization of a vehicle evolving in a structured dynamic environment constitutes a complex problem of crucial importance. However, the low accuracy of the global positioning system (GPS) system in urban environments makes its localization unreliable for further treatments. The combination of GPS data and additional sensors (WSS, IMU or Camera) can improve the localization precision. More and more, digital maps are also used in this process. Generally, these maps are customized or built for a specific application, asking high-cost to design and upgrade. In this paper, we propose a low-cost localization system based on camera, GPS and open map. Starting from the road marking, detected by a multi-kernel estimation method, a particle filter generates the samples taking advantage of lane markings to predict the most probable trajectory of the vehicle and the low-cost GPS position. Then, the accuracy of the localization is improved using an open map. This process was validated through several scenarios with a public database and our experimental platform.


2021 ◽  
Vol 11 (5) ◽  
pp. 2093
Author(s):  
Noé Perrotin ◽  
Nicolas Gardan ◽  
Arnaud Lesprillier ◽  
Clément Le Goff ◽  
Jean-Marc Seigneur ◽  
...  

The recent popularity of trail running and the use of portable sensors capable of measuring many performance results have led to the growth of new fields in sports science experimentation. Trail running is a challenging sport; it usually involves running uphill, which is physically demanding and therefore requires adaptation to the running style. The main objectives of this study were initially to use three “low-cost” sensors. These low-cost sensors can be acquired by most sports practitioners or trainers. In the second step, measurements were taken in ecological conditions orderly to expose the runners to a real trail course. Furthermore, to combine the collected data to analyze the most efficient running techniques according to the typology of the terrain were taken, as well on the whole trail circuit of less than 10km. The three sensors used were (i) a Stryd sensor (Stryd Inc. Boulder CO, USA) based on an inertial measurement unit (IMU), 6 axes (3-axis gyroscope, 3-axis accelerometer) fixed on the top of the runner’s shoe, (ii) a Global Positioning System (GPS) watch and (iii) a heart belt. Twenty-eight trail runners (25 men, 3 women: average age 36 ± 8 years; height: 175.4 ± 7.2 cm; weight: 68.7 ± 8.7 kg) of different levels completed in a single race over a 8.5 km course with 490 m of positive elevation gain. This was performed with different types of terrain uphill (UH), downhill (DH), and road sections (R) at their competitive race pace. On these sections of the course, cadence (SF), step length (SL), ground contact time (GCT), flight time (FT), vertical oscillation (VO), leg stiffness (Kleg), and power (P) were measured with the Stryd. Heart rate, speed, ascent, and descent speed were measured by the heart rate belt and the GPS watch. This study showed that on a ≤10 km trail course the criteria for obtaining a better time on the loop, determined in the test, was consistency in the effort. In a high percentage of climbs (>30%), two running techniques stand out: (i) maintaining a high SF and a short SL and (ii) decreasing the SF but increasing the SL. In addition, it has been shown that in steep (>28%) and technical descents, the average SF of the runners was higher. This happened when their SL was shorter in lower steep and technically challenging descents.


Robotica ◽  
2021 ◽  
pp. 1-18
Author(s):  
Majid Yekkehfallah ◽  
Ming Yang ◽  
Zhiao Cai ◽  
Liang Li ◽  
Chuanxiang Wang

SUMMARY Localization based on visual natural landmarks is one of the state-of-the-art localization methods for automated vehicles that is, however, limited in fast motion and low-texture environments, which can lead to failure. This paper proposes an approach to solve these limitations with an extended Kalman filter (EKF) based on a state estimation algorithm that fuses information from a low-cost MEMS Inertial Measurement Unit and a Time-of-Flight camera. We demonstrate our results in an indoor environment. We show that the proposed approach does not require any global reflective landmark for localization and is fast, accurate, and easy to use with mobile robots.


Sign in / Sign up

Export Citation Format

Share Document