Flipping food during grilling tasks, a dataset of utensils kinematics and dynamics, food pose and subject gaze

This paper presents a multivariate dataset of 2866 food flipping movements, performed by 4 chefs and 5 home cooks, with different grilled food and two utensils (spatula and tweezers). The 3D trajectories of strategic points in the utensils were tracked using optoelectronic motion capture. The pinching force of the tweezers, the bending force and torsion torque of the spatula were also recorded, as well as videos and the subject gaze. These data were collected using a custom experimental setup that allowed the execution of flipping movements with freshly cooked food, without having the sensors near the dangerous cooking area. Complementary, the 2D position of food was computed from the videos. The action of flipping food is, indeed, gaining the attention of both researchers and manufacturers of foodservice technology. The reported dataset contains valuable measurements (1) to characterize and model flipping movements as performed by humans, (2) to develop bio-inspired methods to control a cooking robot, or (3) to study new algorithms for human actions recognition.

Functional cortical localization of tongue movements using corticokinematic coherence with a deep learning-assisted motion capture system

Corticokinematic coherence (CKC) between magnetoencephalographic and movement signals using an accelerometer is useful for the functional localization of the primary sensorimotor cortex (SM1). However, it is difficult to determine the tongue CKC because an accelerometer yields excessive magnetic artifacts. Here, we introduce a novel approach for measuring the tongue CKC using a deep learning-assisted motion capture system with videography, and compare it with an accelerometer in a control task measuring finger movement. Twelve healthy volunteers performed rhythmical side-to-side tongue movements in the whole-head magnetoencephalographic system, which were simultaneously recorded using a video camera and examined using a deep learning-assisted motion capture system. In the control task, right finger CKC measurements were simultaneously evaluated via motion capture and an accelerometer. The right finger CKC with motion capture was significant at the movement frequency peaks or its harmonics over the contralateral hemisphere; the motion-captured CKC was 84.9% similar to that with the accelerometer. The tongue CKC was significant at the movement frequency peaks or its harmonics over both hemispheres. The CKC sources of the tongue were considerably lateral and inferior to those of the finger. Thus, the CKC with deep learning-assisted motion capture can evaluate the functional localization of the tongue SM1.

Combining haptics and inertial motion capture to enhance remote control of a dual-arm robot

High dexterity is required in tasks in which there is contact between objects, such as surface conditioning (wiping, polishing, scuffing, sanding, etc.), specially when the location of the objects involved is unknown or highly inaccurate because they are moving, like a car body in automotive industry lines. These applications require the human adaptability and the robot accuracy. However, sharing the same workspace is not possible in most cases due to safety issues. Hence, a multi-modal teleoperation system combining haptics and an inertial motion capture system is introduced in this work. The human operator gets the sense of touch thanks to haptic feedback, whereas using the motion capture device allows more naturalistic movements. Visual feedback assistance is also introduced to enhance immersion. A Baxter dual-arm robot is used to offer more flexibility and manoeuvrability, allowing to perform two independent operations simultaneously. Several tests have been carried out to assess the proposed system. As it is shown by the experimental results, the task duration is reduced and the overall performance improves thanks to the proposed teleoperation method.

Validation of wearable inertial sensor-based gait analysis system for measurement of spatiotemporal parameters and lower extremity joint kinematics in sagittal plane

Wearable inertial sensor-based motion analysis systems are promising alternatives to standard camera-based motion capture systems for the measurement of gait parameters and joint kinematics. These wearable sensors, unlike camera-based gold standard systems, find usefulness in outdoor natural environment along with confined indoor laboratory-based environment due to miniature size and wireless data transmission. This study reports validation of our developed (i-Sens) wearable motion analysis system against standard motion capture system. Gait analysis was performed at self-selected speed on non-disabled volunteers in indoor ( n = 15) and outdoor ( n = 8) environments. Two i-Sens units were placed at the level of knee and hip along with passive markers (for indoor study only) for simultaneous 3D motion capture using a motion capture system. Mean absolute percentage error (MAPE) was computed for spatiotemporal parameters from the i-Sens system versus the motion capture system as a true reference. Mean and standard deviation of kinematic data for a gait cycle were plotted for both systems against normative data. Joint kinematics data were analyzed to compute the root mean squared error (RMSE) and Pearson’s correlation coefficient. Kinematic plots indicate a high degree of accuracy of the i-Sens system with the reference system. Excellent positive correlation was observed between the two systems in terms of hip and knee joint angles (Indoor: hip 3.98° ± 1.03°, knee 6.48° ± 1.91°, Outdoor: hip 3.94° ± 0.78°, knee 5.82° ± 0.99°) with low RMSE. Reliability characteristics (defined using standard statistical thresholds of MAPE) of stride length, cadence, walking speed in both outdoor and indoor environment were well within the “Good” category. The i-Sens system has emerged as a potentially cost-effective, valid, accurate, and reliable alternative to expensive, standard motion capture systems for gait analysis. Further clinical trials using the i-Sens system are warranted on participants across different age groups.

Effect of the position of the interphalangeal joint on movements of the trapeziometacarpal joint during thumb opposition

The Kapandji test is a simple method to score thumb opposition; however, the position of the interphalangeal joint of the thumb during this test has not been described. We aimed to quantitatively examine the effect of the thumb interphalangeal joint position on movements of the trapeziometacarpal joint during thumb opposition using the Kapandji test. The Kapandji test was carried out in 20 healthy participants during thumb interphalangeal joint extension and flexion. Movements of the joints and the activity of thenar muscles were recorded using motion capture and electromyography, respectively. We found that interphalangeal joint extension increased the trapeziometacarpal joint movement and thenar muscle activity compared with interphalangeal joint flexion, which contributed to thumb opposition at Kapandji Positions 0–6. These findings suggest the position of the thumb interphalangeal joint affects the trapeziometacarpal joint during thumb opposition, and assessment of thumb opposition using the Kapandji test is best done with the thumb interphalangeal joint in extension.

Validation of an Embedded Motion-Capture and EMG Setup for the Analysis of Musculoskeletal Disorder Risks during Manhole Cover Handling

Musculoskeletal disorders in the workplace are a growing problem in Europe. The measurement of these disorders in a working environment presents multiple limitations concerning equipment and measurement reliability. The aim of this study was to evaluate the use of inertial measurement units against a reference system for their use in the workplace. Ten healthy volunteers conducted three lifting methods (snatching, pushing, and pulling) for manhole cover using a custom-made tool weighting 20 and 30 kg. Participants’ back and dominant arm were equipped with IMU, EMG, and reflective markers for VICON analysis and perception of effort was estimated at each trial using a Visual Analog Scale (VAS). The Bland–Altman method was used and results showed good agreement between IMU and VICON systems for Yaw, Pitch and Roll angles (bias values < 1, −4.4 < LOA < 3.6°). EMG results were compared to VAS results and results showed that both are a valuable means to assess efforts during tasks. This study therefore validates the use of inertial measurement units (IMU) for motion capture and its combination with electromyography (EMG) and a Visual Analogic Scale (VAS) to assess effort for use in real work situations.