A High-Frame-Rate Vision System with Automatic Exposure Control

For the purpose of autonomous satellite grasping, a high-speed, low-cost stereo vision system is required with high accuracy. This type of system must be able to detect an object and estimate its range. Hardware solutions are often chosen over software solutions, which tend to be too slow for high frame-rate applications. Designs utilizing field programmable gate arrays (FPGAs) provide flexibility and are cost effective versus solutions that provide similar performance (i.e., Application Specific Integrated Circuits). This thesis presents the architecture and implementation of a high frame-rate stereo vision system based on an FPGA platform. The system acquires stereo images, performs stereo rectification and generates disparity estimates at frame-rates close to 100 fpSi and on a large-enough FPGA, it can process 200 fps. The implementation presents novelties in performance and in the choice of the algorithm implemented. It achieves superior performance to existing systems that estimate scene depth. Furthermore, it demonstrates equivalent accuracy to software implementations of the dynamic programming maximum likelihood stereo correspondence algorithm.

Download Full-text

An Intelligent High-Frame-Rate Video Logging System for Abnormal Behavior Analysis

Journal of Robotics and Mechatronics ◽

10.20965/jrm.2011.p0053 ◽

2011 ◽

Vol 23 (1) ◽

pp. 53-65 ◽

Cited By ~ 2

Author(s):

Yao-DongWang ◽

◽

Idaku Ishii ◽

Takeshi Takaki ◽

Kenji Tajima ◽

...

Keyword(s):

Real Time ◽

Video Processing ◽

High Speed ◽

Vision System ◽

Video Recording ◽

Frame Rate ◽

Abnormal Behavior ◽

High Frame Rate ◽

Abnormal Behavior Detection ◽

Abnormal Behaviors

This paper introduces a high-speed vision system called IDP Express, which can execute real-time image processing and High-Frame-Rate (HFR) video recording simultaneously. In IDP Express, 512×512 pixel images from two camera heads and the processed results on a dedicated FPGA (Field Programmable Gate Array) board are transferred to standard PC memory at a rate of 1000 fps or more. Owing to the simultaneous HFR video processing and recording, IDP Express can be used as an intelligent video logging system for long-term high-speed phenomenon analysis. In this paper, a real-time abnormal behavior detection algorithm was implemented on IDP-Express to capture HFR videos of crucial moments of unpredictable abnormal behaviors in high-speed periodic motions. Several experiments were performed for a high-speed slider machine with repetitive operation at a frequency of 15 Hz and videos of the abnormal behaviors were automatically recorded to verify the effectiveness of our intelligent HFR video logging system.

Download Full-text

High-Frame-Rate Structured Light 3-D Vision for Fast Moving Objects

Journal of Robotics and Mechatronics ◽

10.20965/jrm.2014.p0311 ◽

2014 ◽

Vol 26 (3) ◽

pp. 311-320 ◽

Cited By ~ 9

Author(s):

Yongjiu Liu ◽

◽

Hao Gao ◽

Qingyi Gu ◽

Tadayoshi Aoyama ◽

...

Keyword(s):

Fast Moving ◽

Moving Objects ◽

Vision System ◽

Structured Light ◽

Gray Code ◽

Frame Rate ◽

3D Vision ◽

High Frame Rate ◽

Depth Images ◽

Structured Light Vision

<div class=""abs_img""><img src=""[disp_template_path]/JRM/abst-image/00260003/04.jpg"" width=""300"" />HFR 3D vision system</span></div> This paper presents a fast motion-compensated structured-light vision system that realizes 3-D shape measurement at 500 fps using a high-frame-rate camera-projector system. Multiple light patterns with an 8-bit gray code, are projected on the measured scene at 1000 fps, and are processed in real time for generating 512 × 512 depth images at 500 fps by using the parallel processing of a motion-compensated structured-light method on a GPU board. Several experiments were performed on fast-moving 3-D objects using the proposed method. </span>

Download Full-text

Projection-Mapping-Based Object Pointing Using a High-Frame-Rate Camera-Projector System

10.21203/rs.3.rs-78087/v1 ◽

2020 ◽

Author(s):

Idaku Ishii ◽

Deepak Kumar ◽

Sushil Raut ◽

Kohei Shimasaki ◽

Taku Senoo

Keyword(s):

Real Time ◽

Camera Calibration ◽

Vision System ◽

Frame Rate ◽

Multiple Objects ◽

Projection Mapping ◽

High Frame Rate ◽

Pattern Projection ◽

Modulated Light

Abstract An informative object pointing method using a spatiotemporal-modulated pattern projection is proposed to recognize and localize pointed objects by using a distantly located high-frame-rate vision system. We developed a prototype for projection-mapping-based object pointing that consists of an AI-camera-enabled projection (AiCP) system used as a transmitter, for informative projection mapping, and an HFR vision system operated as a receiver. The AiCP system detects multiple objects in real time at 30 fps with a CNN-based object detector, and simultaneously encodes and projects the recognition results of the detector as 480-Hz-modulated light patterns on to the objects to be pointed. The multiple 480-fps cameras can directly recognize and track the objects pointed at by the AiCP system without camera calibration or complex recognition methods by decoding the brightness signals of pixels in the images. To demonstrate the eectiveness of our proposed method, several desktop experiments using miniature objects and scenes were conducted under various conditions.

Download Full-text

Auto exposure control for high frame rate camera using image histogram feature function

Optics and Precision Engineering ◽

10.3788/ope.20172504.1026 ◽

2017 ◽

Vol 25 (4) ◽

pp. 1026-1035

Author(s):

马泽龙 MA Ze-long ◽

高慧斌 GAO Hui-bin ◽

余毅 YU Yi ◽

蔡立华 CAI Li-hua

Keyword(s):

Frame Rate ◽

Exposure Control ◽

High Frame Rate ◽

Image Histogram ◽

Histogram Feature

Download Full-text

FPGA implementation of high frame rate and ultra-low delay vision system with local and global parallel based matching

2017 Fifteenth IAPR International Conference on Machine Vision Applications (MVA) ◽

10.23919/mva.2017.7986857 ◽

2017 ◽

Cited By ~ 5

Author(s):

Tingting Hu ◽

Takeshi Ikenaga

Keyword(s):

Vision System ◽

Fpga Implementation ◽

Frame Rate ◽

High Frame Rate ◽

Low Delay

Download Full-text

Architecture and implementation of a high frame-rate stereo vision system

10.32920/ryerson.14648928.v1 ◽

2021 ◽

Author(s):

Jamin Islam

Keyword(s):

Integrated Circuits ◽

Stereo Vision ◽

High Speed ◽

Vision System ◽

Low Cost ◽

Cost Effective ◽

Frame Rate ◽

Superior Performance ◽

High Frame Rate ◽

Stereo Vision System

For the purpose of autonomous satellite grasping, a high-speed, low-cost stereo vision system is required with high accuracy. This type of system must be able to detect an object and estimate its range. Hardware solutions are often chosen over software solutions, which tend to be too slow for high frame-rate applications. Designs utilizing field programmable gate arrays (FPGAs) provide flexibility and are cost effective versus solutions that provide similar performance (i.e., Application Specific Integrated Circuits). This thesis presents the architecture and implementation of a high frame-rate stereo vision system based on an FPGA platform. The system acquires stereo images, performs stereo rectification and generates disparity estimates at frame-rates close to 100 fpSi and on a large-enough FPGA, it can process 200 fps. The implementation presents novelties in performance and in the choice of the algorithm implemented. It achieves superior performance to existing systems that estimate scene depth. Furthermore, it demonstrates equivalent accuracy to software implementations of the dynamic programming maximum likelihood stereo correspondence algorithm.

Download Full-text