Real-Time Monocular Three-Dimensional Motion Tracking Using a Multithread Active Vision System

2018 ◽  
Vol 30 (3) ◽  
pp. 453-466 ◽  
Author(s):  
Shaopeng Hu ◽  
◽  
Mingjun Jiang ◽  
Takeshi Takaki ◽  
Idaku Ishii

In this study, we developed a monocular stereo tracking system to be used as a marker-based, three-dimensional (3-D) motion capture system. This system aims to localize dozens of markers on multiple moving objects in real time by switching five hundred different views in 1 s. The ultrafast mirror-drive active vision used in our catadioptric stereo tracking system can accelerate a series of operations for multithread gaze control with video shooting, computation, and actuation within 2 ms. By switching between five hundred different views in 1 s, with real-time video processing for marker extraction, our system can function asJvirtual left and right pan-tilt tracking cameras, operating at 250/Jfps to simultaneously capture and processJpairs of 512 × 512 stereo images with different views via the catadioptric mirror system. We conducted several real-time 3-D motion experiments to capture multiple fast-moving objects with markers. The results demonstrated the effectiveness of our monocular 3-D motion tracking system.

2013 ◽  
Vol 74 (1) ◽  
pp. 11-16 ◽  
Author(s):  
Monique N. Mayer ◽  
Joel L. Lanovaz ◽  
Michael J. Smith ◽  
Narinder Sidhu ◽  
Cheryl L. Waldner

2012 ◽  
Vol 22 (05) ◽  
pp. 1250019 ◽  
Author(s):  
LUIS QUESADA ◽  
ALEJANDRO J. LEÓN

Motion tracking is a critical task in many computer vision applications. Existing motion tracking techniques require either a great amount of knowledge on the target object or specific hardware. These requirements discourage the wide spread of commercial applications based on motion tracking. In this paper, we present a novel three degrees of freedom motion tracking system that needs no knowledge on the target object and that only requires a single low-budget camera that can be found installed in most computers and smartphones. Our system estimates, in real time, the three-dimensional position of a nonmodeled unmarked object that may be nonrigid, nonconvex, partially occluded, self-occluded, or motion blurred, given that it is opaque, evenly colored, enough contrasting with the background in each frame, and that it does not rotate. Our system is also able to determine the most relevant object to track in the screen. Our proposal does not impose additional constraints, therefore it allows a market-wide implementation of applications that require the estimation of the three position degrees of freedom of an object.


2017 ◽  
Vol 14 (5) ◽  
pp. 172988141773275 ◽  
Author(s):  
Francisco J Perez-Grau ◽  
Fernando Caballero ◽  
Antidio Viguria ◽  
Anibal Ollero

This article presents an enhanced version of the Monte Carlo localization algorithm, commonly used for robot navigation in indoor environments, which is suitable for aerial robots moving in a three-dimentional environment and makes use of a combination of measurements from an Red,Green,Blue-Depth (RGB-D) sensor, distances to several radio-tags placed in the environment, and an inertial measurement unit. The approach is demonstrated with an unmanned aerial vehicle flying for 10 min indoors and validated with a very precise motion tracking system. The approach has been implemented using the robot operating system framework and works smoothly on a regular i7 computer, leaving plenty of computational capacity for other navigation tasks such as motion planning or control.


2007 ◽  
Vol 12 (2) ◽  
pp. 91-104 ◽  
Author(s):  
Kenji Fushima ◽  
Masaru Kobayashi ◽  
Hiroaki Konishi ◽  
Kennichi Minagichi ◽  
Takeshi Fukuchi

2007 ◽  
Vol 12 (2) ◽  
pp. 91-104
Author(s):  
Kenji Fushima ◽  
Masaru Kobayashi ◽  
Hiroaki Konishi ◽  
Kennichi Minagichi ◽  
Takeshi Fukuchi

2010 ◽  
Vol 43 (7) ◽  
pp. 1437-1440 ◽  
Author(s):  
Joshua T. Weinhandl ◽  
Brian S.R. Armstrong ◽  
Todd P. Kusik ◽  
Robb T. Barrows ◽  
Kristian M. O’Connor

2021 ◽  
Author(s):  
Gvarami Labartkava

Human vision is a complex system which involves processing frames and retrieving information in a real-time with optimization of the memory, energy and computational resources usage. It can be widely utilized in many real-world applications from security systems to space missions. The research investigates fundamental principles of human vision and accordingly develops a FPGA-based video processing system with binocular vision, capable of high performance and real-time tracking of moving objects in 3D space. The undertaken research and implementation consist of: 1. Analysis of concepts and methods of human vision system; 2. Development stereo and peripheral vision prototype of a system-on-programmable chip (SoPC) for multi-object motion detection and tracking; 3. Verification, test run and analysis of the experimental results gained on the prototype and associated with the performance constraints; The implemented system proposes a platform for real-time applications which are limited in current approaches.


Author(s):  
Ivanka Petkova Veneva ◽  
Dimitar Chakarov ◽  
Mihail Tsveov ◽  
Dimitar Stefanov Trifonov ◽  
Evgeni Zlatanov ◽  
...  

Active orthosis (exoskeleton) is an assistive device with a wearable structure, corresponding to the natural motions of the human. This chapter focuses on developing an active/assistive orthosis system (AOS) enhancing movement. The AOS design is inspired by the biological musculoskeletal system of human upper and lower limbs and mimics the muscle-tendon-ligament structure. The exoskeleton structure includes left and right upper limb, left and right lower limb, and central exoskeleton structure for human torso and waist and provides support, balance, and control of different segments of the body. The device was fabricated with light materials and powered by pneumatic artificial muscles that provide more than fifteen degrees of freedom for the different joints. The active orthotic systems (AOS) can operate in three modes: motion tracking system with data exchange with virtual reality; haptic and rehabilitation device; and assistive mode with active orthosis in cases of impaired muscles.


Sign in / Sign up

Export Citation Format

Share Document