Real-time Implement ORB algorithm in FPGA : oFast with Harris corner and rBrief algorithm

Author(s):  
Jung Rok Kim ◽  
Jae Wook Jeon
Keyword(s):  
2015 ◽  
Vol 27 (1) ◽  
pp. 12-23 ◽  
Author(s):  
Qingyi Gu ◽  
◽  
Sushil Raut ◽  
Ken-ichi Okumura ◽  
Tadayoshi Aoyama ◽  
...  

<div class=""abs_img""><img src=""[disp_template_path]/JRM/abst-image/00270001/02.jpg"" width=""300"" />Synthesized panoramic images</div> In this paper, we propose a real-time image mosaicing system that uses a high-frame-rate video sequence. Our proposed system can mosaic 512 × 512 color images captured at 500 fps as a single synthesized panoramic image in real time by stitching the images based on their estimated frame-to-frame changes in displacement and orientation. In the system, feature point extraction is accelerated by implementing a parallel processing circuit module for Harris corner detection, and hundreds of selected feature points in the current frame can be simultaneously corresponded with those in their neighbor ranges in the previous frame, assuming that frame-to-frame image displacement becomes smaller in high-speed vision. The efficacy of our system for improved feature-based real-time image mosaicing at 500 fps was verified by implementing it on a field-programmable gate array (FPGA)-based high-speed vision platform and conducting several experiments: (1) capturing an indoor scene using a camera mounted on a fast-moving two-degrees-of-freedom active vision, (2) capturing an outdoor scene using a hand-held camera that was rapidly moved in a periodic fashion by hand. </span>


2012 ◽  
Vol 605-607 ◽  
pp. 2227-2231
Author(s):  
Wu Yang Ding ◽  
Ling Zhang ◽  
Yun Hua Chen

A yawning detection method which can be used in drivers’ fatigue monitoring is proposed. To adapt to the variance in different mouth shapes and sizes, it based on mouth inner contour corner detection and curve fitting. First, the Harris corner detection algorithm was used to detect inner mouth feature points. Second, we established the open mouths’ mathematical model by curve fitting those points, calculated the degree of mouth openness using the mouth model, and generated the real-time M-curve. Third, the duration of big openness in successive images is divided into levels for further judgment. The validation results show that the method can obtain more precise mouth parameters and distinguish yawn from complex mouth activities. So the method achieves a higher level of accuracy.


2014 ◽  
Vol 62 (1) ◽  
pp. 139-150 ◽  
Author(s):  
S.A. Mahmoudi ◽  
M. Kierzynka ◽  
P. Manneback ◽  
K. Kurowski

Abstract Motion tracking algorithms are widely used in computer vision related research. However, the new video standards, especially those in high resolutions, cause that current implementations, even running on modern hardware, no longer meet the needs of real-time processing. To overcome this challenge several GPU (Graphics Processing Unit) computing approaches have recently been proposed. Although they present a great potential of a GPU platform, hardly any is able to process high definition video sequences efficiently. Thus, a need arose to develop a tool being able to address the outlined problem. In this paper we present software that implements optical flow motion tracking using the Lucas-Kanade algorithm. It is also integrated with the Harris corner detector and therefore the algorithm may perform sparse tracking, i.e. tracking of the meaningful pixels only. This allows to substantially lower the computational burden of the method. Moreover, both parts of the algorithm, i.e. corner selection and tracking, are implemented on GPU and, as a result, the software is immensely fast, allowing for real-time motion tracking on videos in Full HD or even 4K format. In order to deliver the highest performance, it also supports multiple GPU systems, where it scales up very well


Sign in / Sign up

Export Citation Format

Share Document