scholarly journals 3D Contact Position Estimation of Image-Based Areal Soft Tactile Sensor with Printed Array Markers and Image Sensors

Sensors ◽  
2020 ◽  
Vol 20 (13) ◽  
pp. 3796
Author(s):  
Jong-il Lee ◽  
Suwoong Lee ◽  
Hyun-Min Oh ◽  
Bo Ram Cho ◽  
Kap-Ho Seo ◽  
...  

Tactile sensors have been widely used and researched in various fields of medical and industrial applications. Gradually, they will be used as new input devices and contact sensors for interactive robots. If a tactile sensor is to be applied to various forms of human–machine interactions, it needs to be soft to ensure comfort and safety, and it should be easily customizable and inexpensive. The purpose of this study is to estimate 3D contact position of a novel image-based areal soft tactile sensor (IASTS) using printed array markers and multiple cameras. First, we introduce the hardware structure of the prototype IASTS, which consists of a soft material with printed array markers and multiple cameras with LEDs. Second, an estimation algorithm for the contact position is proposed based on the image processing of the array markers and their Gaussian fittings. A series of basic experiments was conducted and their results were analyzed to verify the effectiveness of the proposed IASTS hardware and its estimation software. To ensure the stability of the estimated contact positions a Kalman filter was developed. Finally, it was shown that the contact positions on the IASTS were estimated with a reasonable error value for soft haptic applications.

Research ◽  
2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Peng Xu ◽  
Xingyu Wang ◽  
Siyuan Wang ◽  
Tianyu Chen ◽  
Jianhua Liu ◽  
...  

Since designing efficient tactile sensors for autonomous robots is still a challenge, this paper proposes a perceptual system based on a bioinspired triboelectric whisker sensor (TWS) that is aimed at reactive obstacle avoidance and local mapping in unknown environments. The proposed TWS is based on a triboelectric nanogenerator (TENG) and mimics the structure of rat whisker follicles. It operates to generate an output voltage via triboelectrification and electrostatic induction between the PTFE pellet and copper films (0.3 mm thickness), where a forced whisker shaft displaces a PTFE pellet (10 mm diameter). With the help of a biologically inspired structural design, the artificial whisker sensor can sense the contact position and approximate the external stimulation area, particularly in a dark environment. To highlight this sensor’s applicability and scalability, we demonstrate different functions, such as controlling LED lights, reactive obstacle avoidance, and local mapping of autonomous surface vehicles. The results show that the proposed TWS can be used as a tactile sensor for reactive obstacle avoidance and local mapping in robotics.


2014 ◽  
Vol 26 (6) ◽  
pp. 743-749 ◽  
Author(s):  
Yuki Mori ◽  
◽  
Ryojun Ikeura ◽  
Ming Ding ◽  
◽  
...  

<div class=""abs_img""><img src=""[disp_template_path]/JRM/abst-image/00260006/07.jpg"" width=""300"" />Position estimation by forearms</div> For a robot that uses two arms to lift and transfer a care receiver from a bed to a wheelchair, we report a method of estimating the positioning of the care receiver. The maneuver for such a task involves a high DOF, and the robot is capable of executing the maneuver much like a human being. The care receiver may experience pain or become unstable when being carried, however, depending on the positioning of contact between the robot’s arms and the care receiver. For this reason, nursing care robots must be able to recognize the positioning of contact with the care receiver and either modify it or alert the operator if it is unsuitable. We use the information obtained by tactile sensors on the robot’s arms when making contact with the care receiver to estimate the latter’s positioning. By dividing a care receiver’s position on a bed into nine zones and applying machine learning to tactile sensor data and positioning, it is possible to estimate positioning highly accurately. </span>


Sensors ◽  
2021 ◽  
Vol 21 (5) ◽  
pp. 1572
Author(s):  
Lukas Merker ◽  
Joachim Steigenberger ◽  
Rafael Marangoni ◽  
Carsten Behn

Just as the sense of touch complements vision in various species, several robots could benefit from advanced tactile sensors, in particular when operating under poor visibility. A prominent tactile sense organ, frequently serving as a natural paragon for developing tactile sensors, is the vibrissae of, e.g., rats. Within this study, we present a vibrissa-inspired sensor concept for 3D object scanning and reconstruction to be exemplarily used in mobile robots. The setup consists of a highly flexible rod attached to a 3D force-torque transducer (measuring device). The scanning process is realized by translationally shifting the base of the rod relative to the object. Consequently, the rod sweeps over the object’s surface, undergoing large bending deflections. Then, the support reactions at the base of the rod are evaluated for contact localization. Presenting a method of theoretically generating these support reactions, we provide an important basis for future parameter studies. During scanning, lateral slip of the rod is not actively prevented, in contrast to literature. In this way, we demonstrate the suitability of the sensor for passively dragging it on a mobile robot. Experimental scanning sweeps using an artificial vibrissa (steel wire) of length 50 mm and a glass sphere as a test object with a diameter of 60 mm verify the theoretical results and serve as a proof of concept.


Mathematics ◽  
2020 ◽  
Vol 8 (9) ◽  
pp. 1434 ◽  
Author(s):  
Wonhee Kim ◽  
Sangmin Suh

For several decades, disturbance observers (DOs) have been widely utilized to enhance tracking performance by reducing external disturbances in different industrial applications. However, although a DO is a verified control structure, a conventional DO does not guarantee stability. This paper proposes a stability-guaranteed design method, while maintaining the DO structure. The proposed design method uses a linear matrix inequality (LMI)-based H∞ control because the LMI-based control guarantees the stability of closed loop systems. However, applying the DO design to the LMI framework is not trivial because there are two control targets, whereas the standard LMI stabilizes a single control target. In this study, the problem is first resolved by building a single fictitious model because the two models are serial and can be considered as a single model from the Q-filter point of view. Using the proposed design framework, all-stabilizing Q filters are calculated. In addition, for the stability and robustness of the DO, two metrics are proposed to quantify the stability and robustness and combined into a single unified index to satisfy both metrics. Based on an application example, it is verified that the proposed method is effective, with a performance improvement of 10.8%.


2021 ◽  
Vol 6 (51) ◽  
pp. eabc8801
Author(s):  
Youcan Yan ◽  
Zhe Hu ◽  
Zhengbao Yang ◽  
Wenzhen Yuan ◽  
Chaoyang Song ◽  
...  

Human skin can sense subtle changes of both normal and shear forces (i.e., self-decoupled) and perceive stimuli with finer resolution than the average spacing between mechanoreceptors (i.e., super-resolved). By contrast, existing tactile sensors for robotic applications are inferior, lacking accurate force decoupling and proper spatial resolution at the same time. Here, we present a soft tactile sensor with self-decoupling and super-resolution abilities by designing a sinusoidally magnetized flexible film (with the thickness ~0.5 millimeters), whose deformation can be detected by a Hall sensor according to the change of magnetic flux densities under external forces. The sensor can accurately measure the normal force and the shear force (demonstrated in one dimension) with a single unit and achieve a 60-fold super-resolved accuracy enhanced by deep learning. By mounting our sensor at the fingertip of a robotic gripper, we show that robots can accomplish challenging tasks such as stably grasping fragile objects under external disturbance and threading a needle via teleoperation. This research provides new insight into tactile sensor design and could be beneficial to various applications in robotics field, such as adaptive grasping, dexterous manipulation, and human-robot interaction.


2005 ◽  
Vol 04 (01) ◽  
pp. 117-126
Author(s):  
N. L. MA ◽  
P. WU

Using density functional theory, we predicted the solution structure of the hydrolyzed 3–aminopropyltriethoxysilane (h–APS), which is a silane coupling agent commonly used in many industrial applications. We have located five stable minima on the potential energy surface of h–APS in which four of them are "neutral", and the remaining one is zwitterionic (dipolar) in nature. Our calculations suggested that the stability of the most stable form of h–APS in water (denoted as II_N) arose from strong intramolecular OH ⋯ N hydrogen bond. The least stable form is the zwitterionic form (I_ZW), which is estimated to be over 90 kJ mol -1 less stable than II_N. The factors governing the relative stabilities of different forms are discussed.


2011 ◽  
Vol 08 (03) ◽  
pp. 181-195
Author(s):  
ZHAOXIAN XIE ◽  
HISASHI YAMAGUCHI ◽  
MASAHITO TSUKANO ◽  
AIGUO MING ◽  
MAKOTO SHIMOJO

As one of the home services by a mobile manipulator system, we are aiming at the realization of the stand-up motion support for elderly people. This work is charaterized by the use of real-time feedback control based on the information from high speed tactile sensors for detecting the contact force as well as its center of pressure between the assisted human and the robot arm. First, this paper introduces the design of the tactile sensor as well as initial experimental results to show the feasibility of the proposed system. Moreover, several fundamental tactile sensing-based motion controllers necessary for the stand-up motion support and their experimental verification are presented. Finally, an assist trajectory generation method for the stand-up motion support by integrating fuzzy logic with tactile sensing is proposed and demonstrated experimentally.


Author(s):  
S. Unsal ◽  
A. Shirkhodaie ◽  
A. H. Soni

Abstract Adding sensing capability to a robot provides the robot with intelligent perception capability and flexibility of decision making. To perform intelligent tasks, robots are highly required to perceive their operating environment, and react accordingly. With this regard, tactile sensors offer to extend the scope of intelligence of a robot for performing tasks which require object touching, recognition, and manipulation. This paper presents the design of an inexpensive pneumatic binary-array tactile sensor for such robotic applications. The paper describes some of the techniques implemented for object recognition from binary sensory information. Furthermore, it details the development of software and hardware which facilitate the sensor to provide useful information to a robot so that the robot perceives its operating environment during manipulation of objects.


Sign in / Sign up

Export Citation Format

Share Document