Long term and robust 6DoF motion tracking for highly dynamic stereo endoscopy videos

2021 ◽  
Vol 94 ◽  
pp. 101995
Author(s):  
Tingting Jia ◽  
Zeike A. Taylor ◽  
Xiaojun Chen
Keyword(s):  
2020 ◽  
Vol 39 (3) ◽  
pp. 3825-3837
Author(s):  
Yibin Chen ◽  
Guohao Nie ◽  
Huanlong Zhang ◽  
Yuxing Feng ◽  
Guanglu Yang

Kernel Correlation Filter (KCF) tracker has shown great potential on precision, robustness and efficiency. However, the candidate region used to train the correlation filter is fixed, so tracking is difficult when the target escapes from the search window due to fast motion. In this paper, an improved KCF is put forward for long-term tracking. At first, the moth-flame optimization (MFO) algorithm is introduced into tracking to search for lost target. Then, the candidate sample strategy of KCF tracking method is adjusted by MFO algorithm to make it has the capability of fast motion tracking. Finally, we use the conservative learning correlation filter to judge the moving state of the target, and combine the improved KCF tracker to form a unified tracking framework. The proposed algorithm is tested on a self-made dataset benchmark. Moreover, our method obtains scores for both the distance precision plot (0.891 and 0.842) and overlap success plots (0.631 and 0.601) on the OTB-2013 and OTB-2015 data sets, respectively. The results demonstrate the feasibility and effectiveness compared with the state-of-the-art methods, especially in dealing with fast or uncertain motion.


Author(s):  
Andrew M. Burton ◽  
Hao Liu ◽  
Steven Battersby ◽  
David Brown ◽  
Nasser Sherkat ◽  
...  

Stroke is the main cause of long term disability worldwide. Of those surviving, more than half will fail to regain functional usage of their impaired upper limb. Typically stroke upper limb rehabilitation exercises consist of repeated movements, which when tracked can form the basis of inputs to games. This paper discusses two systems utilizing Wii™ technology, and thermal and visual tracking respectively to capture motions. The captured motions are used as inputs to specially designed games, which encourage the users to perform repeated rehabilitation movements. This paper discusses the implementation of the two systems, the developed games, and their relative advantages and disadvantages. It also describes the upcoming testing phase of the project.


Author(s):  
Amanda L. Martori ◽  
Stephanie L. Carey ◽  
Redwan Alqasemi ◽  
Daniel Ashley ◽  
Rajiv V. Dubey

Wearable sensor systems have the potential to offer advancements in the study of motion disorders, particularly outside of a laboratory setting during activities of daily living or on a football field. Advantages like portability and the capability to gather real-world data have resulted in the rapid adoption of these sensors in various studies for gait analysis, balance control evaluation, physical activity recognition and fall prevention. However, before using wearable sensors in long-term acquisition studies, it is necessary to quantify and analyze errors and determine their sources. In this study, the accuracy of joint angles and velocities measured with the wearable inertial measurement unit (IMU) sensors were compared to both measurements from an optical motion-tracking system and from encoders on a robotic arm while it completed various predetermined paths. The robotic arm uses incremental encoders at each joint to measure and calculate its Cartesian motion relative to a reference frame using inverse kinematics. Motion profiles of the robotic arm were tracked using the onboard encoders, an eight-camera Vicon (Oxford, UK) motion-tracking system with passive retro-reflective markers, and four wearable IMUs by APDM (Portland, OR). In order to better isolate various types of contributing errors, linear, planar, and 3-dimensional robot motions were used. Data were collected from the sensors over several hours, which provided insight into time-based effects as well as management of large amounts of data for future long-term tracking applications. In addition, the authors have previously seen acquisition errors with high-speed gaits, thus robotic arm trajectories of varying velocities were used to provide further insight into these rate-based effects. Angular velocity and joint angles were compared for all three systems and used to investigate the hysteresis, drift and time-based effects on the IMUs as well as their accuracy during motion tracking. Effects on IMU performance due to the application of filtering algorithms were not investigated. The results show that the IMUs were able to calculate the joint angles within a clinically acceptable range of the gold standard optical motion-tracking system. The IMUs also provided accurate trajectory recognition and angular velocity measurements relative to the known motion input of the robotic arm. Future work will include the development of algorithms to detect gait abnormalities such as those seen in patients with mild traumatic brain injury (mTBI). To complement human subject testing with gait pathology, controlled introduction of gait deviations into this robotic testing framework will allow for well-characterized unit testing, providing more robust algorithm development.


2020 ◽  
Vol 15 (7) ◽  
pp. 799-809
Author(s):  
Yuanfei Xue

Sensor tracking technology has broad prospects of application in the fields of smart home and environmental protection. The passive motion tracking method of sensor networks can realize the perception of location, temperature and other information without carrying sensor nodes. A sparse network tracking system based on infrared sensor nodes is proposed in this study, which can control the running automobiles with unmanned navigation. On the basis of the theory of diffraction, the way of spreading for wireless received signal strength (RSS) can be divided into "scattered waves" and "diffracted waves," which can be regarded as two components of infrared sensing wireless signals so as to further propose the RSS indicators of "long-term testing value" and "short-term test value." Based on these indicators, a measurement model based on diffraction effects and scattering effects is proposed, and an improved particle filter algorithm is used to update the motion tracking. The hardware design of each module in an unmanned vehicle includes the main controller, tracking circuit, serial port circuit, motor control circuit and infrared sensor control circuit of the car. In the experiment, the measurement accuracy of the tracking system based on the sparse infrared photoelectric sensor was first tested. In the simulation experiment, the long-term test value, the short-term test value and the actual measurement value were compared respectively. The test results show that the theoretical RSS value and the actual test result can be matched. Moreover, the infrared photoelectric tracking system is used to design the navigation control system of unmanned cars, helping the car to drive automatically through obstacle avoidance test and tracking obstacle avoidance test.


2011 ◽  
Vol 1 (4) ◽  
pp. 60-73 ◽  
Author(s):  
Andrew M. Burton ◽  
Hao Liu ◽  
Steven Battersby ◽  
David Brown ◽  
Nasser Sherkat ◽  
...  

Stroke is the main cause of long term disability worldwide. Of those surviving, more than half will fail to regain functional usage of their impaired upper limb. Typically stroke upper limb rehabilitation exercises consist of repeated movements, which when tracked can form the basis of inputs to games. This paper discusses two systems utilizing Wii™ technology, and thermal and visual tracking respectively to capture motions. The captured motions are used as inputs to specially designed games, which encourage the users to perform repeated rehabilitation movements. This paper discusses the implementation of the two systems, the developed games, and their relative advantages and disadvantages. It also describes the upcoming testing phase of the project.


Author(s):  
Andrew M. Burton ◽  
Hao Liu ◽  
Steven Battersby ◽  
David Brown ◽  
Nasser Sherkat ◽  
...  

Stroke is the main cause of long term disability worldwide. Of those surviving, more than half will fail to regain functional usage of their impaired upper limb. Typically stroke upper limb rehabilitation exercises consist of repeated movements, which when tracked can form the basis of inputs to games. This paper discusses two systems utilizing Wii™ technology, and thermal and visual tracking respectively to capture motions. The captured motions are used as inputs to specially designed games, which encourage the users to perform repeated rehabilitation movements. This paper discusses the implementation of the two systems, the developed games, and their relative advantages and disadvantages. It also describes the upcoming testing phase of the project.


Author(s):  
Patrick Chwalek ◽  
David Ramsay ◽  
Joseph A. Paradiso

We present Captivates, an open-source smartglasses system designed for long-term, in-the-wild psychophysiological monitoring at scale. Captivates integrate many underutilized physiological sensors in a streamlined package, including temple and nose temperature measurement, blink detection, head motion tracking, activity classification, 3D localization, and head pose estimation. Captivates were designed with an emphasis on: (1) manufacturing and scalability, so we can easily support large scale user studies for ourselves and offer the platform as a generalized tool for ambulatory psychophysiology research; (2) robustness and battery life, so long-term studies result in trustworthy data individual's entire day in natural environments without supervision or recharge; and (3) aesthetics and comfort, so people can wear them in their normal daily contexts without self-consciousness or changes in behavior. Captivates are intended to enable large scale data collection without altering user behavior. We validate that our sensors capture useful data robustly for a small set of beta testers. We also show that our additional effort on aesthetics was imperative to meet our goals; namely, earlier versions of our prototype make people uncomfortable to interact naturally in public, and our additional design and miniaturization effort has made a significant impact in preserving natural behavior. There is tremendous promise in translating psychophysiological laboratory techniques into real-world insight. Captivates serve as an open-source bridge to this end. Paired with an accurate underlying model, Captivates will be able to quantify the long-term psychological impact of our design decisions and provide real-time feedback for technologists interested in actuating a cognitively adaptive, user-aligned future.


2019 ◽  
Vol 42 ◽  
Author(s):  
John P. A. Ioannidis

AbstractNeurobiology-based interventions for mental diseases and searches for useful biomarkers of treatment response have largely failed. Clinical trials should assess interventions related to environmental and social stressors, with long-term follow-up; social rather than biological endpoints; personalized outcomes; and suitable cluster, adaptive, and n-of-1 designs. Labor, education, financial, and other social/political decisions should be evaluated for their impacts on mental disease.


Sign in / Sign up

Export Citation Format

Share Document