scholarly journals Hands-Free User Interface for VR Headsets Based on In Situ Facial Gesture Sensing

Sensors ◽  
2020 ◽  
Vol 20 (24) ◽  
pp. 7206
Author(s):  
Jinhyuk Kim ◽  
Jaekwang Cha ◽  
Shiho Kim
Keyword(s):  
User Interface ◽  
Experimental Tests ◽  
Cost Effective ◽  
Head Movements ◽  
Head Mounted Display ◽  
Facial Gestures ◽  
Free Interaction ◽  
Typical Configuration ◽  
Surgical Operations

The typical configuration of virtual reality (VR) devices consists of a head-mounted display (HMD) and handheld controllers. As such, these units have limited utility in tasks that require hand-free operation, such as in surgical operations or assembly works in cyberspace. We propose a user interface for a VR headset based on a wearer’s facial gestures for hands-free interaction, similar to a touch interface. By sensing and recognizing the expressions associated with the in situ intentional movements of a user’s facial muscles, we define a set of commands that combine predefined facial gestures with head movements. This is achieved by utilizing six pairs of infrared (IR) photocouplers positioned at the foam interface of an HMD. We demonstrate the usability and report on the user experience as well as the performance of the proposed command set using an experimental VR game without any additional controllers. We obtained more than 99% of recognition accuracy for each facial gesture throughout the three steps of experimental tests. The proposed input interface is a cost-effective and efficient solution that facilitates hands-free user operation of a VR headset using built-in infrared photocouplers positioned in the foam interface. The proposed system recognizes facial gestures and incorporates a hands-free user interface to HMD, which is similar to the touch-screen experience of a smartphone.

Remote On-Line Control of a High-Voltage in situ Transmission Electron Microscope with A Rational User Interface

1996 ◽  
Vol 54 ◽  
pp. 384-385
Author(s):  
M.A. O’Keefe ◽  
J. Taylor ◽  
D. Owen ◽  
B. Crowley ◽  
K.H. Westmacott ◽  
...  
Keyword(s):  
Electron Microscopy ◽  
Electron Microscope ◽  
User Interface ◽  
Transmission Electron Microscope ◽  
High Voltage ◽  
Materials Science ◽  
Transmission Electron ◽  
On Line ◽  
Electron Microscopes

Remote on-line electron microscopy is rapidly becoming more available as improvements continue to be developed in the software and hardware of interfaces and networks. Scanning electron microscopes have been driven remotely across both wide and local area networks. Initial implementations with transmission electron microscopes have targeted unique facilities like an advanced analytical electron microscope, a biological 3-D IVEM and a HVEM capable of in situ materials science applications. As implementations of on-line transmission electron microscopy become more widespread, it is essential that suitable standards be developed and followed. Two such standards have been proposed for a high-level protocol language for on-line access, and we have proposed a rational graphical user interface. The user interface we present here is based on experience gained with a full-function materials science application providing users of the National Center for Electron Microscopy with remote on-line access to a 1.5MeV Kratos EM-1500 in situ high-voltage transmission electron microscope via existing wide area networks. We have developed and implemented, and are continuing to refine, a set of tools, protocols, and interfaces to run the Kratos EM-1500 on-line for collaborative research. Computer tools for capturing and manipulating real-time video signals are integrated into a standardized user interface that may be used for remote access to any transmission electron microscope equipped with a suitable control computer.

scholarly journals Performance of microvascular anastomosis with a new robotic visualization system: proof of concept

2021 ◽  
Author(s):  
F. Boehm ◽  
P. J. Schuler ◽  
R. Riepl ◽  
L. Schild ◽  
T. K. Hoffmann ◽  
...  
Keyword(s):  
Ex Vivo ◽  
Body Position ◽  
Head Movements ◽  
Camera System ◽  
Visualization System ◽  
Head Mounted Display ◽  
General Evaluation ◽  
Surgical Field ◽  
Technical Instructions

AbstractMicrovascular procedures require visual magnification of the surgical field, e.g. by a microscope. This can be accompanied by an unergonomic posture with musculoskeletal pain or long-term degenerative changes as the eye is bound to the ocular throughout the whole procedure. The presented study describes the advantages and drawbacks of a 3D exoscope camera system. The RoboticScope®-system (BHS Technologies®, Innsbruck, Austria) features a high-resolution 3D-camera that is placed over the surgical field and a head-mounted-display (HMD) that the camera pictures are transferred to. A motion sensor in the HMD allows for hands-free change of the exoscope position via head movements. For general evaluation of the system functions coronary artery anastomoses of ex-vivo pig hearts were performed. Second, the system was evaluated for anastomosis of a radial-forearm-free-flap in a clinical setting/in vivo. The system positioning was possible entirely hands-free using head movements. Camera control was intuitive; visualization of the operation site was adequate and independent from head or body position. Besides technical instructions of the providing company, there was no special surgical training of the surgeons or involved staff upfront performing the procedures necessary. An ergonomic assessment questionnaire showed a favorable ergonomic position in comparison to surgery with a microscope. The outcome of the operated patient was good. There were no intra- or postoperative complications. The exoscope facilitates a change of head and body position without losing focus of the operation site and an ergonomic working position. Repeated applications have to clarify if the system benefits in clinical routine.

scholarly journals Fabrication of a liquid cell for in situ transmission electron microscopy

Microscopy ◽  
2020 ◽  
Author(s):  
Xiaoguang Li ◽  
Kazutaka Mitsuishi ◽  
Masaki Takeguchi
Keyword(s):  
Electron Microscopy ◽  
Transmission Electron Microscopy ◽  
Cost Effective ◽  
Production Method ◽  
Microscopy Imaging ◽  
Transmission Electron ◽  
In Situ Electron Microscopy ◽  
Liquid Cell ◽  
Si Wafer

Abstract Liquid cell transmission electron microscopy (LCTEM) enables imaging of dynamic processes in liquid with high spatial and temporal resolution. The widely used liquid cell (LC) consists of two stacking microchips with a thin wet sample sandwiched between them. The vertically overlapped electron-transparent membrane windows on the microchips provide passage for the electron beam. However, microchips with imprecise dimensions usually cause poor alignment of the windows and difficulty in acquiring high-quality images. In this study, we developed a new and efficient microchip fabrication process for LCTEM with a large viewing area (180 µm × 40 µm) and evaluated the resultant LC. The new positioning reference marks on the surface of the Si wafer dramatically improve the precision of dicing the wafer, making it possible to accurately align the windows on two stacking microchips. The precise alignment led to a liquid thickness of 125.6 nm close to the edge of the viewing area. The performance of our LC was demonstrated by in situ transmission electron microscopy imaging of the dynamic motions of 2-nm Pt particles. This versatile and cost-effective microchip production method can be used to fabricate other types of microchips for in situ electron microscopy.

scholarly journals Experimental Strain Measurement Approach Using Fiber Bragg Grating Sensors for Monitoring of Railway Switches and Crossings

Sensors ◽  
2021 ◽  
Vol 21 (11) ◽  
pp. 3639
Author(s):  
Abdelfateh Kerrouche ◽  
Taoufik Najeh ◽  
Pablo Jaen-Sola
Keyword(s):  
Fiber Bragg Grating ◽  
Experimental Tests ◽  
Cost Effective ◽  
Measuring Method ◽  
Bragg Grating ◽  
Railway Network ◽  
System Failures ◽  
Railway Infrastructure ◽  
Train Speed ◽  
And Control

Railway infrastructure plays a major role in providing the most cost-effective way to transport freight and passengers. The increase in train speed, traffic growth, heavier axles, and harsh environments make railway assets susceptible to degradation and failure. Railway switches and crossings (S&C) are a key element in any railway network, providing flexible traffic for trains to switch between tracks (through or turnout direction). S&C systems have complex structures, with many components, such as crossing parts, frogs, switchblades, and point machines. Many technologies (e.g., electrical, mechanical, and electronic devices) are used to operate and control S&C. These S&C systems are subject to failures and malfunctions that can cause delays, traffic disruptions, and even deadly accidents. Suitable field-based monitoring techniques to deal with fault detection in railway S&C systems are sought after. Wear is the major cause of S&C system failures. A novel measuring method to monitor excessive wear on the frog, as part of S&C, based on fiber Bragg grating (FBG) optical fiber sensors, is discussed in this paper. The developed solution is based on FBG sensors measuring the strain profile of the frog of S&C to determine wear size. A numerical model of a 3D prototype was developed through the finite element method, to define loading testing conditions, as well as for comparison with experimental tests. The sensors were examined under periodic and controlled loading tests. Results of this pilot study, based on simulation and laboratory tests, have shown a correlation for the static load. It was shown that the results of the experimental and the numerical studies were in good agreement.

Cost effective in-situ methane enrichment for chicken farm biogas system

2021 ◽  
pp. 100773
Author(s):  
Kamoldara Reansuwan ◽  
Rotsukon Jawana ◽  
Saoharit Nitayavardhana ◽  
Sirichai Koonaphapdeelert
Keyword(s):  
Cost Effective ◽  
Chicken Farm

Utilization of the Oculus Rift HMD in Mobile Robot Teleoperation

2014 ◽  
Vol 555 ◽  
pp. 199-208 ◽  
Author(s):  
Tomáš Kot ◽  
Petr Novák
Keyword(s):  
User Interface ◽  
Remote Control ◽  
Mobile Robots ◽  
Graphical User Interface ◽  
Additional Data ◽  
Mobile Robotics ◽  
3D Display ◽  
Oculus Rift ◽  
Head Mounted Display ◽  
In The Beginning

This paper mentions some problems related to utilization of a head-mounted display (HMD) for remote control of mobile robots by a human operator and also presents a possible solution. Considered is specifically the new HMD device called Oculus Rift, which is a very interesting device because of its great parameters and low price. The device is described in the beginning, together with some of the specific principles of the Oculus 3D display. Then follows the design of a new graphical user interface for teleoperation, with main focus on visualization of stereoscopic images from robot cameras. Demonstrated is also a way how to display additional data and information to the operator. The overall aim is to create a comfortable and highly effective interface suitable both for exploration and manipulation tasks in mobile robotics.

A facile approach to fabricate halloysite/metal nanocomposites with preformed and in situ synthesized metal nanoparticles: a comparative study of their enhanced catalytic activity

2015 ◽  
Vol 44 (19) ◽  
pp. 8906-8916 ◽  
Author(s):  
Sankar Das ◽  
Subhra Jana
Keyword(s):  
Catalytic Activity ◽  
Comparative Study ◽  
Metal Nanoparticles ◽  
Heterogeneous Catalysts ◽  
Cost Effective ◽  
Environmentally Benign ◽  
Metal Nanocomposites

Halloysite/metal nanocomposites have been synthesized through the immobilization of preformed and in situ synthesized metal nanoparticles over halloysite surfaces, which in turn produce efficient, cost-effective, and environmentally benign heterogeneous catalysts.

Application of Epoxy Resin for Improvement of the Banana Stem-Acoustic Panel

2021 ◽  
Vol 15 ◽  
Author(s):  
Mohd Azril Riduan ◽  
Mohd Jumain Jalil ◽  
Intan Suhada Azmi ◽  
Afifudin Habulat ◽  
Danial Nuruddin Azlan Raofuddin ◽  
...  
Keyword(s):  
Oleic Acid ◽  
Kinetic Modelling ◽  
Low Cost ◽  
Cost Effective ◽  
Performic Acid ◽  
High Yield ◽  
Renewable Materials ◽  
Runge Kutta Method ◽  
To Come

Background: Greener epoxidation by using vegetable oil to create an eco-friendly epoxide is being studied because it is a more cost-effective and environmentally friendly commodity that is safer than non-renewable materials. The aim of this research is to come up with low-cost solutions for banana trunk acoustic panels with kinetic modelling of epoxy-based palm oil. Method: In this study, the epoxidation of palm oleic acid was carried out by in situ performic acid to produce epoxidized palm oleic acid. Results: Banana trunk acoustic panel was successfully innovated based on the performance when the epoxy was applied. Lastly, a mathematical model was developed by using the numerical integration of the 4th order Runge-Kutta method, and the results showed that there is a good agreement between the simulation and experimental data, which validates the kinetic model. Conclusion: Overall, the peracid mechanism was effective in producing a high yield of epoxy from palm oleic acid that is useful for the improvement of acoustic panels based on the banana trunk.

IoT Based Bus Tracking System

2021 ◽  
Vol 9 (VI) ◽  
pp. 2889-2893
Author(s):  
Miss Payal W. Paratpure
Keyword(s):  
Tracking System ◽  
Cost Effective ◽  
Raspberry Pi ◽  
Accurate Estimation ◽  
Time Of Arrival ◽  
Test Results ◽  
Cloud Server ◽  
Bus Operator ◽  
Gps Device

Tracking of public bus location requires a GPS device to be installed, and lots of bus operators in developing countries don't have such an answer in situ to supply an accurate estimation of bus time of arrival (ETA). Without ETA information, it's very difficult for the overall public to plan their journey effectively. In this paper, implementation of an innovative IOT solution to trace the real time location of buses without requiring the deployment of a GPS device is discussed. It uses Bluetooth Low Energy (BLE) proximity beacon to trace the journey of a bus by deploying an Estimate location beacon on the bus. BLE detection devices (Raspberry Pi 4) are installed at selected bus stops along the path to detect the arrival of buses. Once detected, the situation of the bus is submitted to a cloud server to compute the bus ETAs. A field trial is currently being conducted in Johor, Malaysia together with an area bus operator on one single path. Our test results showed that the detection of BLE beacons is extremely accurate and it's feasible to trace the situation of buses without employing a GPS device during a cost-effective way.

Sign in / Sign up

Export Citation Format

Share Document