Identify Finger Rotation Angles with ArUco Markers and Action Cameras

Author(s):  
Tianyun Yuan ◽  
Yu Song ◽  
Gerald A. Kraan ◽  
Richard HM Goossens

Abstract Measuring the motions of human hand joints is often a challenge due to the high number of degrees of freedom. In this study, we proposed a hand tracking system utilizing action cameras and ArUco markers to continuously measure the rotation angles of hand joints. Three methods were developed to estimate the joint rotation angles. The pos-based method transforms marker positions to a reference coordinate system (RCS) and extracts a hand skeleton to identify the rotation angles. Similarly, the orient-x-based method calculates the rotation angles from the transformed x-orientations of the detected markers in the RCS. In contrast, the orient-mat-based method first identifies the rotation angles in each camera coordinate system using the detected orientations, and then, synthesizes the results regarding each joint. Experiment results indicated that the repeatability errors with one camera regarding different marker sizes were around 2.64 to 27.56 degrees and 0.60 to 2.36 degrees using the marker positions and orientations respectively. When multiple cameras were employed to measure the joint rotation angles, the angles measured by using the three methods were comparable with that measured by a goniometer. Despite larger deviations occurred when using the pos-based method. Further analysis indicated that the results of using the orient-mat-based method can describe more types of joint rotations, and the effectiveness of this method was verified by capturing hand movements of several participants. Thus it is recommended for measuring joint rotation angles in practical setups.

2021 ◽  
Author(s):  
Tianyun Yuan ◽  
Yu (Wolf) Song ◽  
Gerald A. Kraan ◽  
Richard H. M. Goossens

Abstract Measuring the motion of human hand joints is a challenging task due to the high number of DOFs. In this study, we proposed a low-cost hand tracking system built on action cameras and ArUco markers to measure finger joint rotation angles. The lens distortion of each camera was corrected first via intra-calibration and the videos of different cameras were aligned to the reference camera using a dynamic time warping based method. Two methods were proposed and implemented for extracting the rotation angles of finger joints: one is based on the 3D positions of the markers via inter-calibration between cameras, named pos-based method; the other one is based on the relative marker orientation information from individual cameras, named rot-based method. An experiment was conducted to evaluate the effectiveness of the proposed system. The right hand of a volunteer was included in this practical study, where the movement of the fingers was recorded and the finger rotation angles were calculated with the two proposed methods, respectively. The results indicated that although using the rot-based method may collect less data than using the pos-based method, it was more stable and reliable. Therefore, the rot-based method is recommended for measuring finger joint rotation in practical setups.


Sensors ◽  
2020 ◽  
Vol 21 (1) ◽  
pp. 137
Author(s):  
Larisa Dunai ◽  
Martin Novak ◽  
Carmen García Espert

The present paper describes the development of a prosthetic hand based on human hand anatomy. The hand phalanges are printed with 3D printing with Polylactic Acid material. One of the main contributions is the investigation on the prosthetic hand joins; the proposed design enables one to create personalized joins that provide the prosthetic hand a high level of movement by increasing the degrees of freedom of the fingers. Moreover, the driven wire tendons show a progressive grasping movement, being the friction of the tendons with the phalanges very low. Another important point is the use of force sensitive resistors (FSR) for simulating the hand touch pressure. These are used for the grasping stop simulating touch pressure of the fingers. Surface Electromyogram (EMG) sensors allow the user to control the prosthetic hand-grasping start. Their use may provide the prosthetic hand the possibility of the classification of the hand movements. The practical results included in the paper prove the importance of the soft joins for the object manipulation and to get adapted to the object surface. Finally, the force sensitive sensors allow the prosthesis to actuate more naturally by adding conditions and classifications to the Electromyogram sensor.


Author(s):  
Nandhini Kesavan ◽  
Raajan N. R.

The main objective of gesture recognition is to promote the technology behind the automation of registered gesture with a fusion of multidimensional data in a versatile manner. To achieve this goal, computers should be able to visually recognize hand gestures from video input. However, vision-based hand tracking and gesture recognition is an extremely challenging problem due to the complexity of hand gestures, which are rich in diversities due to high degrees of freedom involved by the human hand. This would make the world a better place with for the commons not only to live in, but also to communicate with ease. This research work would serve as a pharos to researchers in the field of smart vision and would immensely help the society in a versatile manner.


Author(s):  
Larisa Dunai ◽  
Martin Novak ◽  
Carmen García Espert

The present paper describes the development of a prosthetic hand based on the human hand anatomy. The hand phalanges are printed by using 3D printed with Polylactic Acid material. One of the main contributions is the investigation on the prosthetic hand joins; the proposed design enables to create personalized joins that allow the prosthetic hand a high level of movement by increasing the degrees of freedom of the fingers. Moreover, the driven wire tendons show a progressive grasping movement, being the friction of the tendons with the phalanges very low. Another important point is the use of force sensitive resistors for simulating the hand touch pressure. These are used for the grasping stop simulating touch pressure of the fingers. Surface Electromyogram (EMG) sensors allow the user to control the prosthetic hand grasping start. Their use may provide the prosthetic hand the possibility of classification of the hand movements. The practical results included in the paper prove the importance of the soft joins for the object manipulation and to get adapted to the object surface. Finally, the force sensitive sensors allow the prosthesis to actuate with more naturalness by adding conditions and classifications to the Electromyogram sensor.


2007 ◽  
Vol 97 (1) ◽  
pp. 604-617 ◽  
Author(s):  
Eliana M. Klier ◽  
Hongying Wang ◽  
J. Douglas Crawford

Two central, related questions in motor control are 1) how the brain represents movement directions of various effectors like the eyes and head and 2) how it constrains their redundant degrees of freedom. The interstitial nucleus of Cajal (INC) integrates velocity commands from the gaze control system into position signals for three-dimensional eye and head posture. It has been shown that the right INC encodes clockwise (CW)-up and CW-down eye and head components, whereas the left INC encodes counterclockwise (CCW)-up and CCW-down components, similar to the sensitivity directions of the vertical semicircular canals. For the eyes, these canal-like coordinates align with Listing’s plane (a behavioral strategy limiting torsion about the gaze axis). By analogy, we predicted that the INC also encodes head orientation in canal-like coordinates, but instead, aligned with the coordinate axes for the Fick strategy (which constrains head torsion). Unilateral stimulation (50 μA, 300 Hz, 200 ms) evoked CW head rotations from the right INC and CCW rotations from the left INC, with variable vertical components. The observed axes of head rotation were consistent with a canal-like coordinate system. Moreover, as predicted, these axes remained fixed in the head, rotating with initial head orientation like the horizontal and torsional axes of a Fick coordinate system. This suggests that the head is ordinarily constrained to zero torsion in Fick coordinates by equally activating CW/CCW populations of neurons in the right/left INC. These data support a simple mechanism for controlling head orientation through the alignment of brain stem neural coordinates with natural behavioral constraints.


2020 ◽  
Author(s):  
Neomi Mizrachi ◽  
Guy Nelinger ◽  
Ehud Ahissar ◽  
Amos Arieli

ABSTRACTHand movements are essential for tactile perception of objects. However, why different individuals converge on specific movement patterns is not yet clear. Focusing on planar shape perception, we tracked the hands of 11 participants while they practiced shape recognition. Our results show that planar shape perception is mediated by contour-following movements, either tangential to the contour or spatially-oscillating perpendicular to it, and by scanning movements, crossing between distant parts of the shapes’ contour. Both strategies exhibited non-uniform coverage of the shapes’ contours. We found that choice of strategy during the first experimental session was strongly correlated with two idiosyncratic parameters: participants with lower tactile resolution tended to move faster; and faster-adapting participants tended to employ oscillatory movements more often. In addition, practicing on isolated geometric features increased the tendency to use the contour-following strategy. These results provide insights into the processes of strategy selection in tactile perception.SIGNIFICANCE STATMENTHand movements are integral components of tactile perception. Yet, the specific motion strategies used to perceive specific objects and features, and their dependence on physiological features and on experience, are understudied. Focusing on planar shape perception and using high-speed hand tracking we show that human participants employ two basic palpation strategies: Contour-following and scanning. We further show that the strategy chosen by each participant and its kinematics depend strongly on the participant’s physiological thresholds – indicative of spatial resolution and temporal adaptation - and on their perceptual experience.


PeerJ ◽  
2018 ◽  
Vol 6 ◽  
pp. e6078 ◽  
Author(s):  
Nayan Bhatt ◽  
Varadhan SKM

Background The human hand can perform a range of manipulation tasks, from holding a pen to holding a hammer. The central nervous system (CNS) uses different strategies in different manipulation tasks based on task requirements. Attempts to compare postures of the hand have been made for use in robotics and animation industries. In this study, we developed an index called the posture similarity index to quantify the similarity between two human hand postures. Methods Twelve right-handed volunteers performed 70 postures, and lifted and held 30 objects (total of 100 different postures, each performed five times). A 16-sensor electromagnetic tracking system captured the kinematics of individual finger phalanges (segments). We modeled the hand as a 21-DoF system and computed the corresponding joint angles. We used principal component analysis to extract kinematic synergies from this 21-DoF data. We developed a posture similarity index (PSI), that represents the similarity between posture in the synergy (Principal component) space. First, we tested the performance of this index using a synthetic dataset. After confirming that it performs well with the synthetic dataset, we used it to analyze the experimental data. Further, we used PSI to identify postures that are “representative” in the sense that they have a greater overlap (in synergy space) with a large number of postures. Results Our results confirmed that PSI is a relatively accurate index of similarity in synergy space both with synthetic data and real experimental data. Also, more special postures than common postures were found among “representative” postures. Conclusion We developed an index for comparing posture similarity in synergy space and demonstrated its utility by using synthetic dataset and experimental dataset. Besides, we found that “special” postures are actually “special” in the sense that there are more of them in the “representative” postures as identified by our posture similarity index.


Author(s):  
Ahmed A. Shabana ◽  
Martin B. Hamper ◽  
James J. O’Shea

In vehicle system dynamics, the effect of the gyroscopic moments can be significant during curve negotiations. The absolute angular velocity of the body can be expressed as the sum of two vectors; one vector is due to the curvature of the curve, while the second vector is due to the rate of changes of the angles that define the orientation of the body with respect to a coordinate system that follows the body motion. In this paper, the configuration of the body in the global coordinate system is defined using the trajectory coordinates in order to examine the effect of the gyroscopic moments in the case of curve negotiations. These coordinates consist of arc length, two relative translations and three relative angles. The relative translations and relative angles are defined with respect to a trajectory coordinate system that follows the motion of the body on the curve. It is shown that when the yaw and roll angles relative to the trajectory coordinate system are constrained and the motion is predominantly rolling, the effect of the gyroscopic moment on the motion becomes negligible, and in the case of pure rolling and zero yaw and roll angles, the generalized gyroscopic moment associated with the system degrees of freedom becomes identically zero. The analysis presented in this investigation sheds light on the danger of using derailment criteria that are not obtained using laws of motion, and therefore, such criteria should not be used in judging the stability of railroad vehicle systems. Furthermore, The analysis presented in this paper shows that the roll moment which can have a significant effect on the wheel/rail contact forces depends on the forward velocity in the case of curve negotiations. For this reason, roller rigs that do not allow for the wheelset forward velocity cannot capture these moment components, and therefore, cannot be used in the analysis of curve negotiations. A model of a suspended railroad wheelset is used in this investigation to study the gyroscopic effect during curve negotiations.


Author(s):  
Thomas E. Pillsbury ◽  
Ryan M. Robinson ◽  
Norman M. Wereley

Pneumatic artificial muscles (PAMs) are used in robotics applications for their light-weight design and superior static performance. Additional PAM benefits are high specific work, high force density, simple design, and long fatigue life. Previous use of PAMs in robotics research has focused on using “large,” full-scale PAMs as actuators. Large PAMs work well for applications with large working volumes that require high force and torque outputs, such as robotic arms. However, in the case of a compact robotic hand, a large number of degrees of freedom are required. A human hand has 35 muscles, so for similar functionality, a robot hand needs a similar number of actuators that must fit in a small volume. Therefore, using full scale PAMs to actuate a robot hand requires a large volume which for robotics and prosthetics applications is not feasible, and smaller actuators, such as miniature PAMs, must be used. In order to develop a miniature PAM capable of producing the forces and contractions needed in a robotic hand, different braid and bladder material combinations were characterized to determine the load stroke profiles. Through this characterization, miniature PAMs were shown to have comparably high force density with the benefit of reduced actuator volume when compared to full scale PAMs. Testing also showed that braid-bladder interactions have an important effect at this scale, which cannot be modeled sufficiently using existing methods without resorting to a higher-order constitutive relationship. Due to the model inaccuracies and the limited selection of commercially available materials at this scale, custom molded bladders were created. PAMs created with these thin, soft bladders exhibited greatly improved performance.


Sign in / Sign up

Export Citation Format

Share Document