scholarly journals Integration of real-time binocular stereo vision and whole body information for dynamic walking navigation of humanoid robot

Author(s):  
K. Okada ◽  
M. Inaba ◽  
H. Inoue
10.5772/50921 ◽  
2012 ◽  
Vol 9 (1) ◽  
pp. 26 ◽  
Author(s):  
Xiao-Bo Lai ◽  
Hai-Shun Wang ◽  
Yue-Hong Xu

To acquire range information for mobile robots, a TMS320DM642 DSP-based range finding system with binocular stereo vision is proposed. Firstly, paired images of the target are captured and a Gaussian filter, as well as improved Sobel kernels, are achieved. Secondly, a feature-based local stereo matching algorithm is performed so that the space location of the target can be determined. Finally, in order to improve the reliability and robustness of the stereo matching algorithm under complex conditions, the confidence filter and the left-right consistency filter are investigated to eliminate the mismatching points. In addition, the range finding algorithm is implemented in the DSP/BIOS operating system to gain real-time control. Experimental results show that the average accuracy of range finding is more than 99% for measuring single-point distances equal to 120cm in the simple scenario and the algorithm takes about 39ms for ranging a time in a complex scenario. The effectivity, as well as the feasibility, of the proposed range finding system are verified.


2013 ◽  
Vol 303-306 ◽  
pp. 313-317 ◽  
Author(s):  
Zhong Wei Zhou ◽  
Min Xu ◽  
Wei Fu ◽  
Ji Zeng Zhao

The goal of this paper is to present a method for object tracking and positioning based on stereo vision in real time. The method effectively combined stereo matching algorithm with object tracking algorithm, and calculated the spatial location information of the object by using binocular stereo vision while the object is being tracked. The stereo matching used dynamic programming, image pyramids and control points modification algorithm, and the object tracking mainly utilized CamShift algorithm in this paper. The experimental results have confirmed that the proposed method realized real-time tracking for moving object, accurate calculating for the object three-dimensional coordinates, which meet the applied needs of servo follow-up system.


Sensors ◽  
2021 ◽  
Vol 21 (6) ◽  
pp. 1944
Author(s):  
Xinhua Wang ◽  
Dayu Li ◽  
Guang Zhang

With the rapid development of the virtual reality industry, one of the bottlenecks is the scarcity of video resources. How to capture high-definition panoramic video with depth information and real-time stereo display has become a key technical problem to be solved. In this paper, the optical optimization design scheme of panoramic imaging based on binocular stereo vision is proposed. Combined with the real-time processing algorithm of multi detector mosaic panoramic stereo imaging image, a panoramic stereo real-time imaging system is developed. Firstly, the optical optimization design scheme of panoramic imaging based on binocular stereo vision is proposed, and the space coordinate calibration platform of ultra-high precision panoramic camera based on theodolite angle compensation function is constructed. The projection matrix of adjacent cameras is obtained by solving the imaging principle of binocular stereo vision. Then, a real-time registration algorithm of multi-detector mosaic image and Lucas-Kanade optical flow method based on image segmentation are proposed to realize stereo matching and depth information estimation of panoramic imaging, and the estimation results are analyzed effectively. Experimental results show that the stereo matching time of panoramic imaging is 30 ms, the registration accuracy is 0.1 pixel, the edge information of depth map is clearer, and it can meet the imaging requirements of different lighting conditions.


Sign in / Sign up

Export Citation Format

Share Document