scholarly journals Can the Shape of a Planar Pathway Be Estimated Using Proximal Forces of Inserting a Flexible Shaft?

2021 ◽  
Vol 8 ◽  
Author(s):  
Jiajun Liu ◽  
Lin Cao ◽  
Soo Jay Phee
Keyword(s):  
Motion Compensation ◽  
Force Feedback ◽  
Haptic Feedback ◽  
Training Data ◽  
Insertion Force ◽  
Shape Information ◽  
Flexible Shaft ◽  
Continuum Structure ◽  
The Continuum ◽  
Bending Angles

The shape information of flexible endoscopes or other continuum structures, e.g., intro-vascular catheters, is needed for accurate navigation, motion compensation, and haptic feedback in robotic surgical systems. Existing methods rely on optical fiber sensors, electromagnetic sensors, or expensive medical imaging modalities such as X-ray fluoroscopy, magnetic resonance imaging, and ultrasound to obtain the shape information of these flexible medical devices. Here, we propose to estimate the shape/curvature of a continuum structure by measuring the force required to insert a flexible shaft into the internal channel/pathway of the continuum. We found that there is a consistent correlation between the measured insertion force and curvature of the planar continuum pathway. A testbed was built to insert a flexible shaft into a planar continuum pathway with adjustable shapes. The insertion forces, insertion displacement, and the shapes of the pathway were recorded. A neural network model was developed to model this correlation based on the training data collected on the testbed. The trained model, tested on the testing data, can accurately estimate the curvature magnitudes and the accumulated bending angles of the pathway simply based on the measured insertion force at the proximal end of the shaft. The approach may be used to estimate the curvature magnitudes and accumulated bending angles of flexible endoscopic surgical robots or catheters for accurate motion compensation, haptic force feedback, localization, or navigation. The advantage of this approach is that the employed proximal force can be easily obtained outside the pathway or continuum structure without any embedded sensor in the continuum structure. Future work is needed to further investigate the correlation between insertion forces and the pathway and enhance the capability of the model in estimating more complex shapes, e.g., spatial shapes with multiple bends.

scholarly journals Measurement of Syringe Needle Forces for a Haptic Robotic Training Device

2017 ◽  
Author(s):  
David Pepley ◽  
Mary Yovanoff ◽  
Katelin Mirkin ◽  
Scarlett Miller ◽  
David Han ◽  
...  
Keyword(s):  
Force Feedback ◽  
Haptic Feedback ◽  
Critical Role ◽  
Needle Insertion ◽  
Robotic Training ◽  
Insertion Force ◽  
Laparoscopic Simulator ◽  
Fresh Frozen ◽  
Needle Insertion Force ◽  
Robotic Simulator

Medical simulation plays a critical role in the training of surgical and medical residents. Training simulators give residents an environment to practice a wide variety of procedures where they can learn and make mistakes without harming a living patient [1]. In recent years, much research has been conducted on applying haptic or force feedback technology to surgical simulators in order to create more effective training devices [2]. Simulators such as the LapSim (laparoscopic simulator) and the PalpSim (palpitation needle insertion simulator) have both utilized haptic feedback arms to provide the physical sensation of performing surgical procedures to the user [3, 4]. The haptic simulator shown in Fig. 1 is currently in development. This virtual reality haptic robotic simulator for central venous catheterization (CVC) utilizes a haptic feedback arm to provide the feeling of a syringe being inserted into neck tissue [5]. Currently, there is little experimental data relating needle force to depth. To determine the forces necessary to program into the haptic robotic device, a force sensing syringe was developed and cadaver experiments were performed. This paper presents the development of a syringe which can accurately measure needle insertion force and the proceeding experiments conducted using this device on a fresh frozen cadaver. The results of these cadaver needle insertions are characterized into force profiles for needle insertion force that are implemented into the haptic based CVC simulator.

Development and Testing of a Telemanipulation System With Arm and Hand Motion

2000 ◽  
Author(s):  
Michael L. Turner ◽  
Ryan P. Findley ◽  
Weston B. Griffin ◽  
Mark R. Cutkosky ◽  
Daniel H. Gomez
Keyword(s):  
Force Feedback ◽  
Haptic Feedback ◽  
Industrial Robot ◽  
Robot Hand ◽  
Robot Arm ◽  
Task Execution ◽  
Hand Motion ◽  
Instrumented Glove ◽  
Simple Manipulation ◽  
Dexterous Robot Hand

Abstract This paper describes the development of a system for dexterous telemanipulation and presents the results of tests involving simple manipulation tasks. The user wears an instrumented glove augmented with an arm-grounded haptic feedback apparatus. A linkage attached to the user’s wrist measures gross motions of the arm. The movements of the user are transferred to a two fingered dexterous robot hand mounted on the end of a 4-DOF industrial robot arm. Forces measured at the robot fingers can be transmitted back to the user via the haptic feedback apparatus. The results obtained in block-stacking and object-rolling experiments indicate that the addition of force feedback to the user did not improve the speed of task execution. In fact, in some cases the presence of incomplete force information is detrimental to performance speed compared to no force information. There are indications that the presence of force feedback did aid in task learning.

Semi-Immersive Virtual Turbine Engine Simulation System

2018 ◽  
Vol 35 (2) ◽  
pp. 149-160 ◽  
Author(s):  
Mustufa H. Abidi ◽  
Abdulrahman M. Al-Ahmari ◽  
Ali Ahmad ◽  
Saber Darmoul ◽  
Wadea Ameen
Keyword(s):  
Virtual Reality ◽  
Force Feedback ◽  
Haptic Feedback ◽  
Design System ◽  
Detection Mechanism ◽  
Turbine Engine ◽  
Surround Sound ◽  
Process Verification ◽  
Engine Simulation ◽  
Assembly Operations

AbstractThe design and verification of assembly operations is essential for planning product production operations. Recently, virtual prototyping has witnessed tremendous progress, and has reached a stage where current environments enable rich and multi-modal interaction between designers and models through stereoscopic visuals, surround sound, and haptic feedback. The benefits of building and using Virtual Reality (VR) models in assembly process verification are discussed in this paper. In this paper, we present the virtual assembly (VA) of an aircraft turbine engine. The assembly parts and sequences are explained using a virtual reality design system. The system enables stereoscopic visuals, surround sounds, and ample and intuitive interaction with developed models. A special software architecture is suggested to describe the assembly parts and assembly sequence in VR. A collision detection mechanism is employed that provides visual feedback to check the interference between components. The system is tested for virtual prototype and assembly sequencing of a turbine engine. We show that the developed system is comprehensive in terms of VR feedback mechanisms, which include visual, auditory, tactile, as well as force feedback. The system is shown to be effective and efficient for validating the design of assembly, part design, and operations planning.

Torque Control of Electrorheological Fluidic Resistive Actuators for Haptic Vehicular Instrument Controls

2005 ◽  
Vol 128 (2) ◽  
pp. 216-226 ◽  
Author(s):  
M. A. Vitrani ◽  
J. Nikitczuk ◽  
G. Morel ◽  
C. Mavroidis ◽  
B. Weinberg
Keyword(s):  
Electric Fields ◽  
Closed Loop ◽  
Force Feedback ◽  
Haptic Feedback ◽  
Control Device ◽  
Torque Control ◽  
Feedback Mechanisms ◽  
Feedforward Loop ◽  
Integral Controller ◽  
Proportional Integral Controller

Force-feedback mechanisms have been designed to simplify and enhance the human-vehicle interface. The increase in secondary controls within vehicle cockpits has created a desire for a simpler, more efficient human-vehicle interface. By consolidating various controls into a single, haptic feedback control device, information can be transmitted to the operator, without requiring the driver’s visual attention. In this paper, the experimental closed loop torque control of electro-rheological fluids (ERF) based resistive actuators for haptic applications is performed. ERFs are liquids that respond mechanically to electric fields by changing their properties, such as viscosity and shear stress electroactively. Using the electrically controlled rheological properties of ERFs, we developed resistive-actuators for haptic devices that can resist human operator forces in a controlled and tunable fashion. In this study, the ERF resistive-actuator analytical model is derived and experimentally verified and accurate closed loop torque control is experimentally achieved using a non-linear proportional integral controller with a feedforward loop.

scholarly journals Visual delay affects force scaling and weight perception during object lifting in virtual reality

2019 ◽  
Vol 121 (4) ◽  
pp. 1398-1409 ◽  
Author(s):  
Vonne van Polanen ◽  
Robert Tibold ◽  
Atsuo Nuruki ◽  
Marco Davare
Keyword(s):  
Virtual Reality ◽  
Multisensory Integration ◽  
Force Feedback ◽  
Haptic Feedback ◽  
Visual Signals ◽  
Visual Events ◽  
Object Lifting ◽  
Relative Weighting ◽  
The Brain ◽  
Visual Delay

Lifting an object requires precise scaling of fingertip forces based on a prediction of object weight. At object contact, a series of tactile and visual events arise that need to be rapidly processed online to fine-tune the planned motor commands for lifting the object. The brain mechanisms underlying multisensory integration serially at transient sensorimotor events, a general feature of actions requiring hand-object interactions, are not yet understood. In this study we tested the relative weighting between haptic and visual signals when they are integrated online into the motor command. We used a new virtual reality setup to desynchronize visual feedback from haptics, which allowed us to probe the relative contribution of haptics and vision in driving participants’ movements when they grasped virtual objects simulated by two force-feedback robots. We found that visual delay changed the profile of fingertip force generation and led participants to perceive objects as heavier than when lifts were performed without visual delay. We further modeled the effect of vision on motor output by manipulating the extent to which delayed visual events could bias the force profile, which allowed us to determine the specific weighting the brain assigns to haptics and vision. Our results show for the first time how visuo-haptic integration is processed at discrete sensorimotor events for controlling object-lifting dynamics and further highlight the organization of multisensory signals online for controlling action and perception. NEW & NOTEWORTHY Dexterous hand movements require rapid integration of information from different senses, in particular touch and vision, at different key time points as movement unfolds. The relative weighting between vision and haptics for object manipulation is unknown. We used object lifting in virtual reality to desynchronize visual and haptic feedback and find out their relative weightings. Our findings shed light on how rapid multisensory integration is processed over a series of discrete sensorimotor control points.

A Real-Time Haptics-Based Deformable Model for Virtual Prototyping and Simulations

2009 ◽  
Author(s):  
Jinling Wang ◽  
Wen F. Lu
Keyword(s):  
Real Time ◽  
Material Properties ◽  
Computer Animation ◽  
Force Feedback ◽  
Haptic Feedback ◽  
Simulation System ◽  
Deformable Model ◽  
Chain Model ◽  
Physically Based ◽  
Update Rate

Virtual reality technology plays an important role in the fields of product design, computer animation, medical simulation, cloth motion, and many others. Especially with the emergence of haptics technology, virtual simulation system provides an intuitive way of human and computer interaction, which allows user to feel and touch the virtual environment. For a real-time simulation system, a physically based deformable model including complex material properties with a high resolution is required. However, such deformable model hardly satisfies the update rate of interactive haptic rendering that exceeds 1 kHz. To tackle this challenge, a real-time volumetric model with haptic feedback is developed in this paper. This model, named as Adaptive S-chain model, extends the S-chain model and integrates the energy-based wave propagation method by the proposed adaptive re-mesh method to achieve realistic graphic and haptic deformation results. The implemented results show that the nonlinear, heterogeneous, anisotropic, shape retaining material properties and large range deformation are well modeled. An accurate force feedback is generated by the proposed Adaptive S-chain model in case study which is quite close to the experiment data.

Development of an Electro-Rheological Fluidic Actuator and Haptic Systems for Vehicular Instrument Control

2003 ◽  
Author(s):  
Avi Fisch ◽  
Jason Nikitczuk ◽  
Brian Weinberg ◽  
Juan Melli-Huber ◽  
Constantinos Mavroidis ◽  
...  
Keyword(s):  
Feedback Control ◽  
Visual Attention ◽  
Electric Field ◽  
Force Feedback ◽  
Haptic Feedback ◽  
Haptic Devices ◽  
Experimental Systems ◽  
Instrument Control ◽  
Control Devices ◽  
Sense Of Touch

Force-feedback methanisms have been designed to simplify and enahance the human-vehicle interface. The increase in secondary controls within vehicle cockpits has created a desire for a simpler, more efficient human-vehicle interface. Haptic system, or systems that interact with the operator’s sense of touch, can be used to consolidate various controls into fever, haptic feedback control devices, so that information can be transmitted to the operator and the operator can change control settings without requiring the driver’s visual attention. In this paper an Electro-Rheological Fluid (ERF) based actuator and mechanisms are presented that provide haptic feedback. ERSs are fluids that change their viscosity in response to an electric field. Using the electrically controlled rheological properties of ERFs, haptic devices have been developed that can resist human operator forces in a controlled and tunable fashion. The design of an ERF-based actuator and its application to a haptic knob and haptic joystick is presented. The analytical model is given, analyses are performed, and experimental systems and data are presented for the actuator. Conceptual methods for the application to the haptic devices are presented.

Sign in / Sign up

Export Citation Format

Share Document