Recognition of contact state of arrayed type tactile sensor by using neural network

Author(s):  
T. Tanaka ◽  
K. Makihira ◽  
S. Aoyagi
2021 ◽  
Vol 10 (4) ◽  
pp. 1-27
Author(s):  
Shengxin Jia ◽  
Veronica J. Santos

The sense of touch is essential for locating buried objects when vision-based approaches are limited. We present an approach for tactile perception when sensorized robot fingertips are used to directly interact with granular media particles in teleoperated systems. We evaluate the effects of linear and nonlinear classifier model architectures and three tactile sensor modalities (vibration, internal fluid pressure, fingerpad deformation) on the accuracy of estimates of fingertip contact state. We propose an architecture called the Sparse-Fusion Recurrent Neural Network (SF-RNN) in which sparse features are autonomously extracted prior to fusing multimodal tactile data in a fully connected RNN input layer. The multimodal SF-RNN model achieved 98.7% test accuracy and was robust to modest variations in granular media type and particle size, fingertip orientation, fingertip speed, and object location. Fingerpad deformation was the most informative modality for haptic exploration within granular media while vibration and internal fluid pressure provided additional information with appropriate signal processing. We introduce a real-time visualization of tactile percepts for remote exploration by constructing a belief map that combines probabilistic contact state estimates and fingertip location. The belief map visualizes the probability of an object being buried in the search region and could be used for planning.


2005 ◽  
Vol 02 (03) ◽  
pp. 181-190 ◽  
Author(s):  
SEIJI AOYAGI ◽  
TAKAAKI TANAKA ◽  
KENJI MAKIHIRA

In this paper, a force sensing element having a pillar and a diaphragm is proposed and thereafter fabricated by micromachining. Piezo resistors are fabricated on a silicon diaphragm for detecting distortions caused by a force input to a pillar on the diaphragm. Since a practical arrayed sensor consisting of many of this element is still under development, the output of an assumed arrayed type tactile sensor is simulated by FEM (finite element method). Using simulated data, the possibility of tactile pattern recognition using a neural network (NN) is investigated. The learning method of NN, the number of units of the input layer and the hidden layer, as well as the number of training data are investigated for realizing high probability of recognition. The 14 subjects having different shape and size are recognized. This recognition succeeded even if the contact position and the rotation angle of these objects are changed.


Micromachines ◽  
2020 ◽  
Vol 11 (6) ◽  
pp. 583
Author(s):  
Weiting Liu ◽  
Binpeng Zhan ◽  
Chunxin Gu ◽  
Ping Yu ◽  
Guoshi Zhang ◽  
...  

Object curvature plays an important role in grasping and manipulation. To be more exact, local curvature is a more useful information for grasping practically. Vision and touch are the two main methods to extract surface curvature of an object, but vision is often limited since the complete contact area is invisible during manipulation. In this paper, the authors propose an object curvature estimation method based on an artificial neural network algorithm through a lab-developed sparse tactile sensor array. The compliant layer covering on the sensor is indispensable for fitting the curved surface. Three types (plane, convex sphere, and convex cylinder) of sample and each type of sample including 30 different radiuses (1 mm to 30 mm) were used in the experiment. The overall classification accuracy was 93.1%. The average curvature radius estimating error based on an artificial neural network (ANN) algorithm was 1.87 mm. When the radius of curvature was bigger than 5 mm, the average relative error was smaller than 20%. As a comparison, the sensor array density we used in this paper was less than 9/cm2, which was smaller than the density of human SAII receptors, but the discrimination result was close to the SAII receptors. Comparison with the curvature discrimination ability of the human body showed that this method has a promising application prospect.


Sign in / Sign up

Export Citation Format

Share Document