scholarly journals A Novel Gesture-Based Control System for Fluorescence Volumetric Data in Virtual Reality

Sensors ◽  
2021 ◽  
Vol 21 (24) ◽  
pp. 8329
Author(s):  
Vratislav Cmiel ◽  
Larisa Chmelikova ◽  
Inna Zumberg ◽  
Martin Kralik

With the development of light microscopy, it is becoming increasingly easy to obtain detailed multicolor fluorescence volumetric data. The need for their appropriate visualization has become an integral part of fluorescence imaging. Virtual reality (VR) technology provides a new way of visualizing multidimensional image data or models so that the entire 3D structure can be intuitively observed, together with different object features or details on or within the object. With the need for imaging advanced volumetric data, demands for the control of virtual object properties are increasing; this happens especially for multicolor objects obtained by fluorescent microscopy. Existing solutions with universal VR controllers or software-based controllers with the need to define sufficient space for the user to manipulate data in VR are not usable in many practical applications. Therefore, we developed a custom gesture-based VR control system with a custom controller connected to the FluoRender visualization environment. A multitouch sensor disk was used for this purpose. Our control system may be a good choice for easier and more comfortable manipulation of virtual objects and their properties, especially using confocal microscopy, which is the most widely used technique for acquiring volumetric fluorescence data so far.

Electronics ◽  
2021 ◽  
Vol 10 (9) ◽  
pp. 1069
Author(s):  
Deyby Huamanchahua ◽  
Adriana Vargas-Martinez ◽  
Ricardo Ramirez-Mendoza

Exoskeletons are an external structural mechanism with joints and links that work in tandem with the user, which increases, reinforces, or restores human performance. Virtual Reality can be used to produce environments, in which the intensity of practice and feedback on performance can be manipulated to provide tailored motor training. Will it be possible to combine both technologies and have them synchronized to reach better performance? This paper consists of the kinematics analysis for the position and orientation synchronization between an n DoF upper-limb exoskeleton pose and a projected object in an immersive virtual reality environment using a VR headset. To achieve this goal, the exoskeletal mechanism is analyzed using Euler angles and the Pieper technique to obtain the equations that lead to its orientation, forward, and inverse kinematic models. This paper extends the author’s previous work by using an early stage upper-limb exoskeleton prototype for the synchronization process.


2009 ◽  
Vol 42 (16) ◽  
pp. 639-644 ◽  
Author(s):  
Hironao Yamada ◽  
Tang Xinxing ◽  
Ni Tao ◽  
Zhao Dingxuan ◽  
Ahmad Anas Yusof

1999 ◽  
Author(s):  
Takeo Asano ◽  
Hiroshi Matsuzaki ◽  
Akito Saito ◽  
Yukihiko Furuhashi ◽  
Yuichiro Akatsuka ◽  
...  

Abstract Practical use of medical simulation system with virtual reality technology is expected because of the learning of the operation procedure. We have therefore developed a neurosurgical simulation system for minimally invasive surgery. Our system is composed of PC and one or two haptic interfaces. Operator can pick up the region of interest to specify the disease portion from DICOM format image data, then three-dimensional model have made by volume and surface rendering with this data. In the next step, system estimates and indicates on CRT the minimally invasive path from the head surface to the disease target that was picked up beforehand by this system which retains healthy human’s three-dimensional atlas data. Finally, the operator can perform a virtual surgery operation by the haptic interface that has been connected to PC, and can cut off an exact or approximate portion of the disease. The operator can feel the resistance from this virtual object. This operation process can be recorded for medical doctors to review later.


High definition television is becoming ever more popular, opening up the market to new high-definition technologies. Image quality and color fidelity have experienced improvements faster than ever. The video surveillance market has been affected by high definition television demand. Since video surveillance calls for large amounts of image data, high-quality video frame rates are generally compromised. However, a network camera that conforms to high definition television standards shows good performance in high frame rate, resolution, and color fidelity. High quality network cameras are a good choice for surveillance video quality.


2012 ◽  
Vol 605-607 ◽  
pp. 1687-1691
Author(s):  
Xian Zhao Yang ◽  
Geng Guo Cheng

This paper studies the synchronization of brushless excitation frequency soft start system design. On the basis of principle of the synchronized machine brushless excitation frequency soft starter system, the practical applications of brushless motor control system are elaborated. Experimental results in engineering show effectiveness of the design.


Electronics ◽  
2019 ◽  
Vol 8 (1) ◽  
pp. 33 ◽  
Author(s):  
George K. Adam ◽  
Panagiotis A. Kontaxis ◽  
Lambros T. Doulos ◽  
Evangelos-Nikolaos D. Madias ◽  
Constantinos A. Bouroussis ◽  
...  

Although with the advent of the LEDs the energy consumption in buildings can be reduced by 50%, there exists a potential for energy savings due to lighting controls. Moreover, lighting controls can ensure that the near zero energy requirements by EU can be achieved for near zero energy buildings (nZEBs). For this reason, more sophisticated lighting controls must be proposed in order to take full advantage of LEDs and their flexibility concerning dimming. This paper proposes the architecture of an embedded computer camera controller for monitoring and management of image data, which is applied in various control cases, and particularly in digitally controlled lighting devices. The proposed system deals with real-time monitoring and management of a GigE camera input. An in-house developed algorithm using MATLAB enables the identification of areas in luminance values. The embedded microcontroller is part of a complete lighting control system with an imaging sensor in order to measure and control the illumination of several working areas of a room. The power consumption of the proposed lighting system was measured and was compared with the power consumption of a typical photosensor. The functional performance and operation of the proposed camera control system architecture was evaluated based upon a BeagleBone Black microcontroller board.


2020 ◽  
Vol 21 (Supplement_1) ◽  
Author(s):  
G Wheeler ◽  
S Deng ◽  
K Pushparajah ◽  
J A Schnabel ◽  
J M Simpson ◽  
...  

Abstract Funding Acknowledgements Work supported by the NIHR i4i funded 3D Heart project [II-LA-0716-20001] Background/Introduction Virtual Reality (VR) has recently gained great interest for examining 3D images from congenital heart disease (CHD) patients. Currently, 3D printed models of the heart may be used for particularly complex cases. These have been found to be intuitive and to positively impact clinical decision-making. Although positively received, such printed models must be segmented from the image data, generally only CT/MR may be used, the prints are static, and models do not allow for cropping / slicing or easy manipulation. Our VR system is designed to address these issues, as well as providing a simple interface compared to standard software. Building such a VR system, one with intuitive interaction which is clinically useful, requires studying user acceptance and requirements. Purpose: We evaluate the usability of our VR system can a prototype VR system be easily learned and used by clinicians unfamiliar with VR. Method We tested a VR system which can display 3D echo images and enables the user to interact with them, for instance by translating, rotating and cropping. Our system is tested on a transoesophageal echocardiogram from a patient with aortic valve disease. 13 clinicians evaluated the system including 5 imaging cardiologists, 5 physiologists, 2 surgeons and an interventionist, with their clinical experience ranging from trainee to more than 5 years’ of experience. None had used VR regularly in the past. After a brief training session, they were asked to place three anatomical landmarks and identify a particular cardiac view. They then completed a questionnaire on system ease of learning and image manipulation. Results: Results are shown in the figure below. Learning to use the system was perceived as easy for all but one participant, who rated it as ‘Somewhat difficult’. However, once trained, all users found the system easy to use. Participants found the interaction, where objects in the scene are picked up using the controller and then track the controller’s motion in a 1:1 way, to be particularly easy to learn and use. Conclusion Our VR system was accepted by the vast majority of clinicians, both for ease of learning and use. Intuitiveness and the ability to interact with images in a natural way were highlighted as most useful - suggesting that such a system could become accepted for routine clinical use in the future. Abstract P1417 Figure. VR system evaluation participant feedbac


Technologies ◽  
2020 ◽  
Vol 8 (4) ◽  
pp. 77
Author(s):  
Sanika Doolani ◽  
Callen Wessels ◽  
Varun Kanal ◽  
Christos Sevastopoulos ◽  
Ashish Jaiswal ◽  
...  

Recently, the use of extended reality (XR) systems has been on the rise, to tackle various domains such as training, education, safety, etc. With the recent advances in augmented reality (AR), virtual reality (VR) and mixed reality (MR) technologies and ease of availability of high-end, commercially available hardware, the manufacturing industry has seen a rise in the use of advanced XR technologies to train its workforce. While several research publications exist on applications of XR in manufacturing training, a comprehensive review of recent works and applications is lacking to present a clear progress in using such advance technologies. To this end, we present a review of the current state-of-the-art of use of XR technologies in training personnel in the field of manufacturing. First, we put forth the need of XR in manufacturing. We then present several key application domains where XR is being currently applied, notably in maintenance training and in performing assembly task. We also reviewed the applications of XR in other vocational domains and how they can be leveraged in the manufacturing industry. We finally present some current barriers to XR adoption in manufacturing training and highlight the current limitations that should be considered when looking to develop and apply practical applications of XR.


2011 ◽  
Vol 383-390 ◽  
pp. 5176-5181
Author(s):  
Chong Sheng Hou

The accurate measurement of the length of steel plate is the key to control technology for cross-cutting production line. Three steel plates determining-length control algorithms were deeply analyzed, in the set-length control strategy fuzzy control technology was introduced, and determining-length fuzzy controller structure and realization was analyzed; In order to improve the accuracy of steel plate crosscut, on the basis of the fuzzy control system self-learning function and artificial self-learning function were increased. Practical applications show that technical advancement, reliability of the control system and shear plate accuracy are high, fully meet the requirements of control.


Sign in / Sign up

Export Citation Format

Share Document