Research on Design, Calibration and Real-Time Image Expansion Technology of Unmanned System Variable-Scale Panoramic Vision System

This paper summarized the research status, imaging model, systems calibration, distortion correction, and panoramic expansion of panoramic vision systems, pointed out the existing problems and put forward the prospect of future research. According to the research status of panoramic vision systems, a panoramic vision system with single viewpoint of refraction and reflection is designed. The systems had the characteristics of fast acquisition, low manufacturing cost, fixed single-view imaging, integrated imaging, and automatic switching depth of field. Based on these systems, an improved nonlinear optimization polynomial fitting method is proposed to calibrate the monocular HOVS, and the binocular HOVS is calibrated with the Aruco label. This method not only improves the robustness of the calibration results, but also simplifies the calibration process. Finally, a real-time method of panoramic map of multi-function vehicle based on vcam is proposed.

Download Full-text

An augmented-reality-based real-time panoramic vision system for autonomous navigation

IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans ◽

10.1109/tsmca.2005.859177 ◽

2006 ◽

Vol 36 (1) ◽

pp. 154-161 ◽

Cited By ~ 9

Author(s):

S. Dasgupta ◽

A. Banerjee

Keyword(s):

Augmented Reality ◽

Real Time ◽

Autonomous Navigation ◽

Vision System ◽

Panoramic Vision

Download Full-text

Real-Time Unwrapping and Rectification of High-Resolution Catadioptric Panoramic Video during Non-Stationary Moving

Applied Mechanics and Materials ◽

10.4028/www.scientific.net/amm.668-669.1098 ◽

2014 ◽

Vol 668-669 ◽

pp. 1098-1101

Author(s):

Jian Wang ◽

Zhen Hai Zhang ◽

Ke Jie Li ◽

Hai Yan Shao ◽

Tao Xu ◽

...

Keyword(s):

Image Processing ◽

High Resolution ◽

Real Time ◽

Stationary State ◽

Vision System ◽

Image Rectification ◽

Panoramic Vision ◽

Panoramic Video ◽

Environment Perception ◽

Very High

Catadioptric panoramic vision system has been widely used in many fields, and also plays a very important role in environment perception of unmanned platform especially. However, the resolution of system is not very high, usually less than 5 million pixels at present. Even if the resolution is high, but the unwrapping and rectification of panoramic video is carried out off-line. Further, the system is also applied in stationary state or low stationary moving. This paper proposes an unwrapping and rectification method based on high-resolution catadioptric panoramic vision system used during non-stationary moving. It can segment dynamic circular mark region accurately and get the coordinates of center of circular image real-timely, shorten the time of image processing, meanwhile the coordinates of center and radius of the circular mark region would be obtained, so the image distortion caused by inaccurate center coordinates can be reduced. During image rectification, after achieving radial distortions parameters (K1, K2, K3), decentering distortions parameters (P1, P2), and the correction factor that has no physical meanings, we can used those for fitting the rectification polynomial, so the panoramic video can be rectified without distortion.

Download Full-text

A Real-Time Panoramic Vision System for Autonomous Navigation

Proceedings of the 2004 Winter Simulation Conference, 2004. ◽

10.1109/wsc.2004.1371520 ◽

2005 ◽

Cited By ~ 2

Author(s):

S. Dasgupta ◽

A. Banerjee

Keyword(s):

Real Time ◽

Autonomous Navigation ◽

Vision System ◽

Panoramic Vision

Download Full-text

Reliable Real-Time Ball Tracking for Robot Table Tennis

Robotics ◽

10.3390/robotics8040090 ◽

2019 ◽

Vol 8 (4) ◽

pp. 90 ◽

Cited By ~ 2

Author(s):

Sebastian Gomez-Gonzalez ◽

Yassine Nemmour ◽

Bernhard Schölkopf ◽

Jan Peters

Keyword(s):

Object Detection ◽

Real Time ◽

Heuristic Algorithms ◽

Vision System ◽

Tracking System ◽

Sampling Rate ◽

Future Research ◽

Table Tennis ◽

The Real ◽

Ball Tracking

Robot table tennis systems require a vision system that can track the ball position with low latency and high sampling rate. Altering the ball to simplify the tracking using, for instance, infrared coating changes the physics of the ball trajectory. As a result, table tennis systems use custom tracking systems to track the ball based on heuristic algorithms respecting the real-time constrains applied to RGB images captured with a set of cameras. However, these heuristic algorithms often report erroneous ball positions, and the table tennis policies typically need to incorporate additional heuristics to detect and possibly correct outliers. In this paper, we propose a vision system for object detection and tracking that focuses on reliability while providing real-time performance. Our assumption is that by using multiple cameras, we can find and discard the errors obtained in the object detection phase by checking for consistency with the positions reported by other cameras. We provide an open source implementation of the proposed tracking system to simplify future research in robot table tennis or related tracking applications with strong real-time requirements. We evaluate the proposed system thoroughly in simulation and in the real system, outperforming previous work. Furthermore, we show that the accuracy and robustness of the proposed system increases as more cameras are added. Finally, we evaluate the table tennis playing performance of an existing method in the real robot using the proposed vision system. We measure a slight increase in performance compared to a previous vision system even after removing all the heuristics previously present to filter out erroneous ball observations.

Download Full-text

383 Harnessing the Power of Computer Vision System to Improve Management Decisions in Livestock Operations

Journal of Animal Science ◽

10.1093/jas/skaa278.255 ◽

2020 ◽

Vol 98 (Supplement_4) ◽

pp. 138-139

Author(s):

Joao R Dorea ◽

Tiago Bresolin ◽

Rafael E P Ferreira ◽

Luiz Gustavo R Pereira

Keyword(s):

Computer Vision ◽

Body Weight ◽

Real Time ◽

Vision System ◽

Labor Costs ◽

Computer Vision System ◽

Vision Systems ◽

Management Decisions ◽

Level Information ◽

Computer Vision Systems

Abstract In livestock operations, systematically monitoring animal body weight, biometric body measurements, animal behavior, feed bunk, and other complex phenotypes is unfeasible due to labor, costs, and animal stress. Applications of computer vision are growing in importance in livestock systems due to their ability to generate real-time, non-invasive, and accurate animal-level information. Such technology has emerged as a powerful tool to predict animal identification, body weight, biometric measurements, complex behavioral traits, and feed bunk score. However, the development of a computer vision system requires sophisticated statistical and computational approaches for efficient data management and appropriate data mining, as it involves massive datasets. The objective of this talk is to provide an overview of how computer vision systems can be an effective tool to integrate animal-level information and to create predictive modeling for precise management decisions. We will discuss some of the challenges, applications, and potentials of computer vision systems in livestock, and some examples to be presented include: (1) monitoring animal growth and behavior; (2) automated feed bunk management; (3) individual animal recognition; and (4) particle size distribution in total mixed ration. The development of computer vision technologies will potentially have a major impact in the livestock industry by predicting real-time and accurate phenotypes, which, in the future, could be used to improve farm management decisions, breeding programs, and to build optimal data-driven interventions.

Download Full-text

Analysis of coaxial vision systems for real-time Z-height control for laser cladding process

International Congress on Applications of Lasers & Electro-Optics ◽

10.2351/1.5062449 ◽

2012 ◽

Author(s):

Rezak Mezari ◽

Pascal Aubry ◽

Thierry Malot ◽

Kevin Verdier

Keyword(s):

Real Time ◽

Laser Cladding ◽

Vision Systems ◽

Height Control ◽

Laser Cladding Process

Download Full-text

A flexible ultrasensitive optoelectronic sensor array for neuromorphic vision systems

Nature Communications ◽

10.1038/s41467-021-22047-w ◽

2021 ◽

Vol 12 (1) ◽

Author(s):

Qian-Bing Zhu ◽

Bo Li ◽

Dan-Dan Yang ◽

Chi Liu ◽

Shun Feng ◽

...

Keyword(s):

Sensor Array ◽

Vision System ◽

Vision Systems ◽

Neuromorphic Circuits ◽

Image Sensing ◽

Perovskite Quantum Dots ◽

Optoelectronic Sensor ◽

Weak Light ◽

Do So ◽

Neuromorphic Vision

AbstractThe challenges of developing neuromorphic vision systems inspired by the human eye come not only from how to recreate the flexibility, sophistication, and adaptability of animal systems, but also how to do so with computational efficiency and elegance. Similar to biological systems, these neuromorphic circuits integrate functions of image sensing, memory and processing into the device, and process continuous analog brightness signal in real-time. High-integration, flexibility and ultra-sensitivity are essential for practical artificial vision systems that attempt to emulate biological processing. Here, we present a flexible optoelectronic sensor array of 1024 pixels using a combination of carbon nanotubes and perovskite quantum dots as active materials for an efficient neuromorphic vision system. The device has an extraordinary sensitivity to light with a responsivity of 5.1 × 107 A/W and a specific detectivity of 2 × 1016 Jones, and demonstrates neuromorphic reinforcement learning by training the sensor array with a weak light pulse of 1 μW/cm2.

Download Full-text

Data integration by two-sensors in a LEAP-based Virtual Glove for human-system interaction

Multimedia Tools and Applications ◽

10.1007/s11042-020-10296-8 ◽

2021 ◽

Author(s):

Giuseppe Placidi ◽

Danilo Avola ◽

Luigi Cinque ◽

Matteo Polsinelli ◽

Eleni Theodoridou ◽

...

Keyword(s):

Data Integration ◽

Real Time ◽

Vision System ◽

Hand Tracking ◽

Selection Strategy ◽

Motion Sensors ◽

Leap Motion ◽

Time Data ◽

Lower Velocity ◽

Human System

AbstractVirtual Glove (VG) is a low-cost computer vision system that utilizes two orthogonal LEAP motion sensors to provide detailed 4D hand tracking in real–time. VG can find many applications in the field of human-system interaction, such as remote control of machines or tele-rehabilitation. An innovative and efficient data-integration strategy, based on the velocity calculation, for selecting data from one of the LEAPs at each time, is proposed for VG. The position of each joint of the hand model, when obscured to a LEAP, is guessed and tends to flicker. Since VG uses two LEAP sensors, two spatial representations are available each moment for each joint: the method consists of the selection of the one with the lower velocity at each time instant. Choosing the smoother trajectory leads to VG stabilization and precision optimization, reduces occlusions (parts of the hand or handling objects obscuring other hand parts) and/or, when both sensors are seeing the same joint, reduces the number of outliers produced by hardware instabilities. The strategy is experimentally evaluated, in terms of reduction of outliers with respect to a previously used data selection strategy on VG, and results are reported and discussed. In the future, an objective test set has to be imagined, designed, and realized, also with the help of an external precise positioning equipment, to allow also quantitative and objective evaluation of the gain in precision and, maybe, of the intrinsic limitations of the proposed strategy. Moreover, advanced Artificial Intelligence-based (AI-based) real-time data integration strategies, specific for VG, will be designed and tested on the resulting dataset.

Download Full-text

Effects of Steel Fiber Percentage and Aspect Ratios on Fresh and Harden Properties of Ultra-High Performance Fiber

Applied Mechanics ◽

10.3390/applmech2030028 ◽

2021 ◽

Vol 2 (3) ◽

pp. 501-515

Author(s):

Rajib Kumar Biswas ◽

Farabi Bin Ahmed ◽

Md. Ehsanul Haque ◽

Afra Anam Provasha ◽

Zahid Hasan ◽

...

Keyword(s):

Mechanical Properties ◽

Aspect Ratio ◽

High Performance ◽

Steel Fiber ◽

Setting Time ◽

Fiber Reinforced Concrete ◽

Future Research ◽

Manufacturing Cost ◽

Aspect Ratios ◽

High Performance Fiber

Steel fibers and their aspect ratios are important parameters that have significant influence on the mechanical properties of ultrahigh-performance fiber-reinforced concrete (UHPFRC). Steel fiber dosage also significantly contributes to the initial manufacturing cost of UHPFRC. This study presents a comprehensive literature review of the effects of steel fiber percentages and aspect ratios on the setting time, workability, and mechanical properties of UHPFRC. It was evident that (1) an increase in steel fiber dosage and aspect ratio negatively impacted workability, owing to the interlocking between fibers; (2) compressive strength was positively influenced by the steel fiber dosage and aspect ratio; and (3) a faster loading rate significantly improved the mechanical properties. There were also some shortcomings in the measurement method for setting time. Lastly, this research highlights current issues for future research. The findings of the study are useful for practicing engineers to understand the distinctive characteristics of UHPFRC.

Download Full-text