scholarly journals Movement Analysis for Neurological and Musculoskeletal Disorders Using Graph Convolutional Neural Network

2021 ◽  
Vol 13 (8) ◽  
pp. 194
Author(s):  
Ibsa K. Jalata ◽  
Thanh-Dat Truong ◽  
Jessica L. Allen ◽  
Han-Seok Seo ◽  
Khoa Luu
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Musculoskeletal Disorders ◽  
Motion Capture ◽  
Wearable Sensors ◽  
Patient Specific ◽  
Motion Sensors ◽  
Convolutional Network ◽  
Optical Motion ◽  
Optical Motion Capture

Using optical motion capture and wearable sensors is a common way to analyze impaired movement in individuals with neurological and musculoskeletal disorders. However, using optical motion sensors and wearable sensors is expensive and often requires highly trained professionals to identify specific impairments. In this work, we proposed a graph convolutional neural network that mimics the intuition of physical therapists to identify patient-specific impairments based on video of a patient. In addition, two modeling approaches are compared: a graph convolutional network applied solely on skeleton input data and a graph convolutional network accompanied with a 1-dimensional convolutional neural network (1D-CNN). Experiments on the dataset showed that the proposed method not only improves the correlation of the predicted gait measure with the ground truth value (speed = 0.791, gait deviation index (GDI) = 0.792) but also enables faster training with fewer parameters. In conclusion, the proposed method shows that the possibility of using video-based data to treat neurological and musculoskeletal disorders with acceptable accuracy instead of depending on the expensive and labor-intensive optical motion capture systems.

scholarly journals DeepMoCap: Deep Optical Motion Capture Using Multiple Depth Sensors and Retro-Reflectors

Sensors ◽  
2019 ◽  
Vol 19 (2) ◽  
pp. 282 ◽  
Author(s):  
Anargyros Chatzitofis ◽  
Dimitrios Zarpalas ◽  
Stefanos Kollias ◽  
Petros Daras
Keyword(s):  
Optical Flow ◽  
Motion Capture ◽  
Temporal Correlation ◽  
Optical Data ◽  
Convolutional Network ◽  
Depth Sensors ◽  
Depth Images ◽  
3D Space ◽  
Optical Motion ◽  
Optical Motion Capture

In this paper, a marker-based, single-person optical motion capture method (DeepMoCap) is proposed using multiple spatio-temporally aligned infrared-depth sensors and retro-reflective straps and patches (reflectors). DeepMoCap explores motion capture by automatically localizing and labeling reflectors on depth images and, subsequently, on 3D space. Introducing a non-parametric representation to encode the temporal correlation among pairs of colorized depthmaps and 3D optical flow frames, a multi-stage Fully Convolutional Network (FCN) architecture is proposed to jointly learn reflector locations and their temporal dependency among sequential frames. The extracted reflector 2D locations are spatially mapped in 3D space, resulting in robust 3D optical data extraction. The subject’s motion is efficiently captured by applying a template-based fitting technique on the extracted optical data. Two datasets have been created and made publicly available for evaluation purposes; one comprising multi-view depth and 3D optical flow annotated images (DMC2.5D), and a second, consisting of spatio-temporally aligned multi-view depth images along with skeleton, inertial and ground truth MoCap data (DMC3D). The FCN model outperforms its competitors on the DMC2.5D dataset using 2D Percentage of Correct Keypoints (PCK) metric, while the motion capture outcome is evaluated against RGB-D and inertial data fusion approaches on DMC3D, outperforming the next best method by 4 . 5 % in total 3D PCK accuracy.

scholarly journals Convolutional Neural Network-Based Artificial Intelligence for Classification of Protein Localization Patterns

Biomolecules ◽  
2021 ◽  
Vol 11 (2) ◽  
pp. 264
Author(s):  
Kaisa Liimatainen ◽  
Riku Huttunen ◽  
Leena Latonen ◽  
Pekka Ruusuvuori
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Convolutional Neural Network ◽  
High Throughput ◽  
Protein Function ◽  
Protein Localization ◽  
Convolutional Network ◽  
High Throughput Analysis ◽  
Fully Convolutional Network

Identifying localization of proteins and their specific subpopulations associated with certain cellular compartments is crucial for understanding protein function and interactions with other macromolecules. Fluorescence microscopy is a powerful method to assess protein localizations, with increasing demand of automated high throughput analysis methods to supplement the technical advancements in high throughput imaging. Here, we study the applicability of deep neural network-based artificial intelligence in classification of protein localization in 13 cellular subcompartments. We use deep learning-based on convolutional neural network and fully convolutional network with similar architectures for the classification task, aiming at achieving accurate classification, but importantly, also comparison of the networks. Our results show that both types of convolutional neural networks perform well in protein localization classification tasks for major cellular organelles. Yet, in this study, the fully convolutional network outperforms the convolutional neural network in classification of images with multiple simultaneous protein localizations. We find that the fully convolutional network, using output visualizing the identified localizations, is a very useful tool for systematic protein localization assessment.

scholarly journals Evaluation of Power Insulator Detection Efficiency with the Use of Limited Training Dataset

2020 ◽  
Vol 10 (6) ◽  
pp. 2104
Author(s):  
Michał Tomaszewski ◽  
Paweł Michalski ◽  
Jakub Osuchowski
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Object Detection ◽  
Convolutional Neural Network ◽  
Deep Neural Networks ◽  
Detection Efficiency ◽  
Training Data ◽  
Training Dataset ◽  
Training Set ◽  
Convolutional Network

This article presents an analysis of the effectiveness of object detection in digital images with the application of a limited quantity of input. The possibility of using a limited set of learning data was achieved by developing a detailed scenario of the task, which strictly defined the conditions of detector operation in the considered case of a convolutional neural network. The described solution utilizes known architectures of deep neural networks in the process of learning and object detection. The article presents comparisons of results from detecting the most popular deep neural networks while maintaining a limited training set composed of a specific number of selected images from diagnostic video. The analyzed input material was recorded during an inspection flight conducted along high-voltage lines. The object detector was built for a power insulator. The main contribution of the presented papier is the evidence that a limited training set (in our case, just 60 training frames) could be used for object detection, assuming an outdoor scenario with low variability of environmental conditions. The decision of which network will generate the best result for such a limited training set is not a trivial task. Conducted research suggests that the deep neural networks will achieve different levels of effectiveness depending on the amount of training data. The most beneficial results were obtained for two convolutional neural networks: the faster region-convolutional neural network (faster R-CNN) and the region-based fully convolutional network (R-FCN). Faster R-CNN reached the highest AP (average precision) at a level of 0.8 for 60 frames. The R-FCN model gained a worse AP result; however, it can be noted that the relationship between the number of input samples and the obtained results has a significantly lower influence than in the case of other CNN models, which, in the authors’ assessment, is a desired feature in the case of a limited training set.

scholarly journals Graph Convolutional Network and Convolutional Neural Network Based Method for Predicting lncRNA-Disease Associations

Cells ◽  
2019 ◽  
Vol 8 (9) ◽  
pp. 1012 ◽  
Author(s):  
Xuan ◽  
Pan ◽  
Zhang ◽  
Liu ◽  
Sun
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Heterogeneous Network ◽  
Heterogeneous Data ◽  
Superior Performance ◽  
Convolutional Network ◽  
Topological Information ◽  
Disease Pair ◽  
Disease Associations ◽  
The Right

Aberrant expressions of long non-coding RNAs (lncRNAs) are often associated with diseases and identification of disease-related lncRNAs is helpful for elucidating complex pathogenesis. Recent methods for predicting associations between lncRNAs and diseases integrate their pertinent heterogeneous data. However, they failed to deeply integrate topological information of heterogeneous network comprising lncRNAs, diseases, and miRNAs. We proposed a novel method based on the graph convolutional network and convolutional neural network, referred to as GCNLDA, to infer disease-related lncRNA candidates. The heterogeneous network containing the lncRNA, disease, and miRNA nodes, is constructed firstly. The embedding matrix of a lncRNA-disease node pair was constructed according to various biological premises about lncRNAs, diseases, and miRNAs. A new framework based on a graph convolutional network and a convolutional neural network was developed to learn network and local representations of the lncRNA-disease pair. On the left side of the framework, the autoencoder based on graph convolution deeply integrated topological information within the heterogeneous lncRNA-disease-miRNA network. Moreover, as different node features have discriminative contributions to the association prediction, an attention mechanism at node feature level is constructed. The left side learnt the network representation of the lncRNA-disease pair. The convolutional neural networks on the right side of the framework learnt the local representation of the lncRNA-disease pair by focusing on the similarities, associations, and interactions that are only related to the pair. Compared to several state-of-the-art prediction methods, GCNLDA had superior performance. Case studies on stomach cancer, osteosarcoma, and lung cancer confirmed that GCNLDA effectively discovers the potential lncRNA-disease associations.

scholarly journals Gap Reconstruction in Optical Motion Capture Sequences Using Neural Networks

Sensors ◽  
2021 ◽  
Vol 21 (18) ◽  
pp. 6115
Author(s):  
Przemysław Skurowski ◽  
Magdalena Pawlyta
Keyword(s):  
Neural Networks ◽  
Motion Capture ◽  
Matrix Completion ◽  
Input Sequence ◽  
Feedforward Neural Networks ◽  
Network Architectures ◽  
Motion Data ◽  
Optical Motion ◽  
Body Kinematic ◽  
Optical Motion Capture

Optical motion capture is a mature contemporary technique for the acquisition of motion data; alas, it is non-error-free. Due to technical limitations and occlusions of markers, gaps might occur in such recordings. The article reviews various neural network architectures applied to the gap-filling problem in motion capture sequences within the FBM framework providing a representation of body kinematic structure. The results are compared with interpolation and matrix completion methods. We found out that, for longer sequences, simple linear feedforward neural networks can outperform the other, sophisticated architectures, but these outcomes might be affected by the small amount of data availabe for training. We were also able to identify that the acceleration and monotonicity of input sequence are the parameters that have a notable impact on the obtained results.

scholarly journals Use of computer innovative technologies in improving the dartsmen training

2020 ◽  
Vol 26 ◽  
pp. 00061
Author(s):  
Elina Makarova ◽  
Vladislav Dubatovkin ◽  
Nataliya Berezinskaya ◽  
Lyudmila Barkhatova ◽  
Elena Oleynik
Keyword(s):  
Motion Capture ◽  
Body Parts ◽  
Visual Material ◽  
Video Cameras ◽  
Dart Throwing ◽  
Optical Motion ◽  
Optical Motion Capture ◽  
Effective Use ◽  
Near Future ◽  
Motion Capture Systems

The research is focused on studying the possibility of effective use of the dart grip system, the work of the athlete’s hand, to prepare the dartsman for competitions using the MOSAR complex. The experiment uses optical motion capture systems, a set of video cameras, led parameter sensors, and devices that allow to record the movement of body parts and a dart. This method of training and controlling dart throwing can serve as educational and visual material for training future athletes. The use of such motion capture systems in the near future may become one of the main aspects of training, both beginners and professionals, in many sports.

Sign in / Sign up

Export Citation Format

Share Document