A Dielectric Elastomer-Based Multimodal Capacitive Sensor

Dielectric elastomer (DE) sensors have been widely used in a wide variety of applications, such as in robotic hands, wearable sensors, rehabilitation devices, etc. A unique dielectric elastomer-based multimodal capacitive sensor has been developed to quantify the pressure and the location of any touch simultaneously. This multimodal sensor is a soft, flexible, and stretchable dielectric elastomer (DE) capacitive pressure mat that is composed of a multi-layer soft and stretchy DE sensor. The top layer measures the applied pressure, while the underlying sensor array enables location identification. The sensor is placed on a passive elastomeric substrate in order to increase deformation and optimize the sensor’s sensitivity. This DE multimodal capacitive sensor, with pressure and localization capability, paves the way for further development with potential applications in bio-mechatronics technology and other humanoid devices. The sensor design could be useful for robotic and other applications, such as fruit picking or as a bio-instrument for the diabetic insole.

Comparison between rigid and soft poly-articulated prosthetic hands in non-expert myo-electric users shows advantages of soft robotics

Notwithstanding the advancement of modern bionic hands and the large variety of prosthetic hands in the market, commercial devices still present limited acceptance and percentage of daily use. While commercial prostheses present rigid mechanical structures, emerging trends in the design of robotic hands are moving towards soft technologies. Although this approach is inspired by nature and could be promising for prosthetic applications, there is scant literature concerning its benefits for end-users and in real-life scenarios. In this work, we evaluate and assess the role and the benefits of soft robotic technologies in the field of prosthetics. We propose a thorough comparison between rigid and soft characteristics of two poly-articulated hands in 5 non-expert myo-electric prosthesis users in pre- and post-therapeutic training conditions. The protocol includes two standard functional assessments, three surveys for user-perception, and three customized tests to evaluate the sense of embodiment. Results highlight that rigid hands provide a more precise grasp, while soft properties show higher functionalities thanks to their adaptability to different requirements, intuitive use and more natural execution of activities of daily living. This comprehensive evaluation suggests that softness could also promote a quick integration of the system in non-expert users.

Integrated linkage-driven dexterous anthropomorphic robotic hand

Robotic hands perform several amazing functions similar to the human hands, thereby offering high flexibility in terms of the tasks performed. However, developing integrated hands without additional actuation parts while maintaining important functions such as human-level dexterity and grasping force is challenging. The actuation parts make it difficult to integrate these hands into existing robotic arms, thus limiting their applicability. Based on a linkage-driven mechanism, an integrated linkage-driven dexterous anthropomorphic robotic hand called ILDA hand, which integrates all the components required for actuation and sensing and possesses high dexterity, is developed. It has the following features: 15-degree-of-freedom (20 joints), a fingertip force of 34N, compact size (maximum length: 218 mm) without additional parts, low weight of 1.1 kg, and tactile sensing capabilities. Actual manipulation tasks involving tools used in everyday life are performed with the hand mounted on a commercial robot arm.

Upper-Limb Electromyogram Classification of Reaching-to-Grasping Tasks Based on Convolutional Neural Networks for Control of a Prosthetic Hand

In recent years, myoelectric interfaces using surface electromyogram (EMG) signals have been developed for assisting people with physical disabilities. Especially, in the myoelectric interfaces for robotic hands or arms, decoding the user’s upper-limb movement intentions is cardinal to properly control the prosthesis. However, because previous experiments were implemented with only healthy subjects, the possibility of classifying reaching-to-grasping based on the EMG signals from the residual limb without the below-elbow muscles was not investigated yet. Therefore, we aimed to investigate the possibility of classifying reaching-to-grasping tasks using the EMG from the upper arm and upper body without considering wrist muscles for prosthetic users. In our study, seven healthy subjects, one trans-radial amputee, and one wrist amputee were participated and performed 10 repeatable 12 reaching-to-grasping tasks based on the Southampton Hand Assessment Procedure (SHAP) with 12 different weighted (light and heavy) objects. The acquired EMG was processed using the principal component analysis (PCA) and convolutional neural network (CNN) to decode the tasks. The PCA–CNN method showed that the average accuracies of the healthy subjects were 69.4 ± 11.4%, using only the EMG signals by the upper arm and upper body. The result with the PCA–CNN method showed 8% significantly higher accuracies than the result with the widely used time domain and auto-regressive-support vector machine (TDAR–SVM) method as 61.6 ± 13.7%. However, in the cases of the amputees, the PCA–CNN showed slightly lower performance. In addition, in the aspects of assistant daily living, because grip force is also important when grasping an object after reaching, the possibility of classifying the two light and heavy objects in each reaching-to-grasping task was also investigated. Consequently, the PCA–CNN method showed higher accuracy at 70.1 ± 9.8%. Based on our results, the PCA–CNN method can help to improve the performance of classifying reaching-to-grasping tasks without wrist EMG signals. Our findings and decoding method can be implemented to further develop a practical human–machine interface using EMG signals.

Experimental Evaluation of Tactile Sensors for Compliant Robotic Hands

The sense of touch is a key aspect in the human capability to robustly grasp and manipulate a wide variety of objects. Despite many years of development, there is still no preferred solution for tactile sensing in robotic hands: multiple technologies are available, each one with different benefits depending on the application. This study compares the performance of different tactile sensors mounted on the variable stiffness gripper CLASH 2F, including three commercial sensors: a single taxel sensor from the companies Tacterion and Kinfinity, the Robotic Finger Sensor v2 from Sparkfun, plus a self-built resistive 3 × 3 sensor array, and two self-built magnetic 3-DoF touch sensors, one with four taxels and one with one taxel. We verify the minimal force detectable by the sensors, test if slip detection is possible with the available taxels on each sensor, and use the sensors for edge detection to obtain the orientation of the grasped object. To evaluate the benefits obtained with each technology and to assess which sensor fits better the control loop in a variable stiffness hand, we use the CLASH gripper to grasp fruits and vegetables following a published benchmark for pick and place operations. To facilitate the repetition of tests, the CLASH hand is endowed with tactile buttons that ease human–robot interactions, including execution of a predefined program, resetting errors, or commanding the full robot to move in gravity compensation mode.

Hand-Object Interaction: From Human Demonstrations to Robot Manipulation

Human-object interaction is of great relevance for robots to operate in human environments. However, state-of-the-art robotic hands are far from replicating humans skills. It is, therefore, essential to study how humans use their hands to develop similar robotic capabilities. This article presents a deep dive into hand-object interaction and human demonstrations, highlighting the main challenges in this research area and suggesting desirable future developments. To this extent, the article presents a general definition of the hand-object interaction problem together with a concise review for each of the main subproblems involved, namely: sensing, perception, and learning. Furthermore, the article discusses the interplay between these subproblems and describes how their interaction in learning from demonstration contributes to the success of robot manipulation. In this way, the article provides a broad overview of the interdisciplinary approaches necessary for a robotic system to learn new manipulation skills by observing human behavior in the real world.

Development of a novel robotic hand with soft materials and rigid structures

Purpose Rigid robotic hands are generally fast, precise and capable of exerting large forces, whereas soft robotic hands are compliant, safe and adaptive to complex environments. It is valuable and challenging to develop soft-rigid robotic hands that have both types of capabilities. The paper aims to address the challenge through developing a paradigm to achieve the behaviors of soft and rigid robotic hands adaptively. Design/methodology/approach The design principle of a two-joint finger is proposed. A kinematic model and a stiffness enhancement method are proposed and discussed. The manufacturing process for the soft-rigid finger is presented. Experiments are carried out to validate the accuracy of the kinematic model and evaluate the performance of the flexible body of the finger. Finally, a robotic hand composed of two soft-rigid fingers is fabricated to demonstrate its grasping capacities. Findings The kinematic model can capture the desired distal deflection and comprehensive shape accurately. The stiffness enhancement method guarantees stable grasp of the robotic hand, without sacrificing its flexibility and adaptability. The robotic hand is lightweight and practical. It can exhibit different grasping capacities. Practical implications It can be applied in the field of industrial grasping, where the objects are varied in materials and geometry. The hand’s inherent characteristic removes the need to detect and react to slight variations in surface geometry and makes the control strategies simple. Originality/value This work proposes a novel robotic hand. It possesses three distinct characteristics, i.e. high compliance, exhibiting discrete or continuous kinematics adaptively, lightweight and practical structures.

Design of a Single-Material Complex Structure Anthropomorphic Robotic Hand

In the field of robotic hand design, soft body and anthropomorphic design are two trends with a promising future. Designing soft body anthropomorphic robotic hands with human-like grasping ability, but with a simple and reliable structure, is a challenge that still has not been not fully solved. In this paper, we present an anatomically correct robotic hand 3D model that aims to realize the human hand’s functionality using a single type of 3D-printable material. Our robotic hand 3D model is combined with bones, ligaments, tendons, pulley systems, and tissue. We also describe the fabrication method to rapidly produce our robotic hand in 3D printing, wherein all parts are made by elastic 50 A (shore durometer) resin. In the experimental section, we show that our robotic hand has a similar motion range to a human hand with substantial grasping strength and compare it with the latest other designs of anthropomorphic robotic hands. Our new design greatly reduces the fabrication cost and assembly time. Compared with other robotic hand designs, we think our robotic hand may induce a new approach to the design and production of robotic hands as well as other related mechanical structures.

Object Manipulation with an Anthropomorphic Robotic Hand via Deep Reinforcement Learning with a Synergy Space of Natural Hand Poses

Anthropomorphic robotic hands are designed to attain dexterous movements and flexibility much like human hands. Achieving human-like object manipulation remains a challenge especially due to the control complexity of the anthropomorphic robotic hand with a high degree of freedom. In this work, we propose a deep reinforcement learning (DRL) to train a policy using a synergy space for generating natural grasping and relocation of variously shaped objects using an anthropomorphic robotic hand. A synergy space is created using a continuous normalizing flow network with point clouds of haptic areas, representing natural hand poses obtained from human grasping demonstrations. The DRL policy accesses the synergistic representation and derives natural hand poses through a deep regressor for object grasping and relocation tasks. Our proposed synergy-based DRL achieves an average success rate of 88.38% for the object manipulation tasks, while the standard DRL without synergy space only achieves 50.66%. Qualitative results show the proposed synergy-based DRL policy produces human-like finger placements over the surface of each object including apple, banana, flashlight, camera, lightbulb, and hammer.