scholarly journals Fighting Deepfakes Using Body Language Analysis

Forecasting ◽  
2021 ◽  
Vol 3 (2) ◽  
pp. 303-321
Author(s):  
Robail Yasrab ◽  
Wanqi Jiang ◽  
Adnan Riaz
Keyword(s):  
Open Source Software ◽  
Detection Method ◽  
Body Language ◽  
Classification Model ◽  
Upper Body ◽  
Final Model ◽  
Ulterior Motive ◽  
Language Analysis ◽  
Barrier To Entry ◽  
Lstm Network

Recent improvements in deepfake creation have made deepfake videos more realistic. Moreover, open-source software has made deepfake creation more accessible, which reduces the barrier to entry for deepfake creation. This could pose a threat to the people’s privacy. There is a potential danger if the deepfake creation techniques are used by people with an ulterior motive to produce deepfake videos of world leaders to disrupt the order of countries and the world. Therefore, research into the automatic detection of deepfaked media is essential for public security. In this work, we propose a deepfake detection method using upper body language analysis. Specifically, a many-to-one LSTM network was designed and trained as a classification model for deepfake detection. Different models were trained by varying the hyperparameters to build a final model with benchmark accuracy. We achieved 94.39% accuracy on the deepfake test set. The experimental results showed that upper body language can effectively detect deepfakes.

scholarly journals Fighting Deepfakes Using Body Language Analysis

2021 ◽  
Author(s):  
Robail Yasrab ◽  
Wanqi Jiang ◽  
Adnan Riaz
Keyword(s):  
Open Source Software ◽  
Body Language ◽  
Classification Model ◽  
Upper Body ◽  
Final Model ◽  
The Public ◽  
Ulterior Motive ◽  
Language Analysis ◽  
Barrier To Entry ◽  
Lstm Network

Recent improvements in deepfake creation made deepfake videos more realistic. Open-source software has also made deepfake creation more accessible, which reduces the barrier to entry for deepfake creation. This could pose a threat to the public privacy. It is a potential danger if the deepfake creation techniques are used by people with an ulterior motive to produce deepfake videos of world leaders to disrupt the order of the countries and the world. Research into automated detection for deepfaked media is therefore essential for public safety. We propose in this work the use of upper body language analysis for deepfake detection. Specifically, a many-to-one LSTM network was designed and trained as a classification model is trained for deepfake detection. Different models trained using various hyper-parameters to build a final model with benchmark accuracy. We achieve 94.39% accuracy on a test deepfake set. The experimental results show that upper body language can effectively provide identification and deepfake detection.

scholarly journals Fighting Deepfakes Using Body Language Analysis

2021 ◽  
Author(s):  
Robail Yasrab ◽  
Wanqi Jiang ◽  
Adnan Riaz
Keyword(s):  
Open Source Software ◽  
Body Language ◽  
Classification Model ◽  
Upper Body ◽  
Final Model ◽  
Ulterior Motive ◽  
The People ◽  
Language Analysis ◽  
Barrier To Entry ◽  
Lstm Network

Recent improvements in deepfake creation have made deepfake videos more realistic. Moreover, open-source software has made deepfake creation more accessible, which reduces the barrier to entry for deepfake creation. This could pose a threat to the people’s privacy. There is a potential danger if the deepfake creation techniques are used by people with an ulterior motive to produce deepfake videos of world leaders to disrupt the order of countries and the world. Therefore, research into the automatic detection of deepfaked media is essential for public security. In this work, we propose a deepfake detection method using upper body language analysis. Specifically, a many-to-one LSTM network was designed and trained as a classification model for deepfake detection. Different models were trained by varying the hyperparameters to build a final model with benchmark accuracy. We achieved 94.39% accuracy on the deepfake test set. The experimental results showed that upper body language can effectively detect deepfakes.

KArSL

2021 ◽  
Vol 20 (1) ◽  
pp. 1-19
Author(s):  
Ala Addin I. Sidig ◽  
Hamzah Luqman ◽  
Sabri Mahmoud ◽  
Mohamed Mohandes
Keyword(s):  
Deep Learning ◽  
Sign Language ◽  
Markov Models ◽  
Body Language ◽  
Arab Countries ◽  
Microsoft Kinect ◽  
Classification Model ◽  
Language Recognition ◽  
Sign Language Recognition ◽  
Arabic Sign Language

Sign language is the major means of communication for the deaf community. It uses body language and gestures such as hand shapes, lib patterns, and facial expressions to convey a message. Sign language is geography-specific, as it differs from one country to another. Arabic Sign language is used in all Arab countries. The availability of a comprehensive benchmarking database for ArSL is one of the challenges of the automatic recognition of Arabic Sign language. This article introduces KArSL database for ArSL, consisting of 502 signs that cover 11 chapters of ArSL dictionary. Signs in KArSL database are performed by three professional signers, and each sign is repeated 50 times by each signer. The database is recorded using state-of-art multi-modal Microsoft Kinect V2. We also propose three approaches for sign language recognition using this database. The proposed systems are Hidden Markov Models, deep learning images’ classification model applied on an image composed of shots of the video of the sign, and attention-based deep learning captioning system. Recognition accuracies of these systems indicate their suitability for such a large number of Arabic signs. The techniques are also tested on a publicly available database. KArSL database will be made freely available for interested researchers.

scholarly journals Image Classification for the Automatic Feature Extraction in Human Worn Fashion Data

Mathematics ◽  
2021 ◽  
Vol 9 (6) ◽  
pp. 624
Author(s):  
Stefan Rohrmanstorfer ◽  
Mikhail Komarov ◽  
Felix Mödritscher
Keyword(s):  
Neural Networks ◽  
Feature Extraction ◽  
Image Classification ◽  
Convolutional Neural Networks ◽  
Data Augmentation ◽  
State Of The Art ◽  
Image Data ◽  
Classification Model ◽  
Upper Body ◽  
Automatic Feature Extraction

With the always increasing amount of image data, it has become a necessity to automatically look for and process information in these images. As fashion is captured in images, the fashion sector provides the perfect foundation to be supported by the integration of a service or application that is built on an image classification model. In this article, the state of the art for image classification is analyzed and discussed. Based on the elaborated knowledge, four different approaches will be implemented to successfully extract features out of fashion data. For this purpose, a human-worn fashion dataset with 2567 images was created, but it was significantly enlarged by the performed image operations. The results show that convolutional neural networks are the undisputed standard for classifying images, and that TensorFlow is the best library to build them. Moreover, through the introduction of dropout layers, data augmentation and transfer learning, model overfitting was successfully prevented, and it was possible to incrementally improve the validation accuracy of the created dataset from an initial 69% to a final validation accuracy of 84%. More distinct apparel like trousers, shoes and hats were better classified than other upper body clothes.

A Novel ECG Automatic Detection Using LongShort-Term Memory Network and Internet of Things Technology

2021 ◽  
Vol 11 (6) ◽  
pp. 1592-1598
Author(s):  
Xufei Liu
Keyword(s):  
Machine Learning ◽  
Cardiovascular Diseases ◽  
Internet Of Things ◽  
Network Structure ◽  
Recognition Rate ◽  
Classification Model ◽  
Data Set ◽  
Public Data ◽  
Lstm Network ◽  
Internet Of Things Technology

The early detection of cardiovascular diseases based on electrocardiogram (ECG) is very important for the timely treatment of cardiovascular patients, which increases the survival rate of patients. ECG is a visual representation that describes changes in cardiac bioelectricity and is the basis for detecting heart health. With the rise of edge machine learning and Internet of Things (IoT) technologies, small machine learning models have received attention. This study proposes an ECG automatic classification method based on Internet of Things technology and LSTM network to achieve early monitoring and early prevention of cardiovascular diseases. Specifically, this paper first proposes a single-layer bidirectional LSTM network structure. Make full use of the timing-dependent features of the sampling points before and after to automatically extract features. The network structure is more lightweight and the calculation complexity is lower. In order to verify the effectiveness of the proposed classification model, the relevant comparison algorithm is used to verify on the MIT-BIH public data set. Secondly, the model is embedded in a wearable device to automatically classify the collected ECG. Finally, when an abnormality is detected, the user is alerted by an alarm. The experimental results show that the proposed model has a simple structure and a high classification and recognition rate, which can meet the needs of wearable devices for monitoring ECG of patients.

A new rail crack detection method using LSTM network for actual application based on AE technology

2018 ◽  
Vol 142 ◽  
pp. 78-86 ◽  
Author(s):  
Xin Zhang ◽  
Zhongxian Zou ◽  
Kangwei Wang ◽  
Qiushi Hao ◽  
Yan Wang ◽  
...  
Keyword(s):  
Crack Detection ◽  
Detection Method ◽  
Actual Application ◽  
Lstm Network

Network Intrusion Detection Method Based on RS-LSSVM

2014 ◽  
Vol 602-605 ◽  
pp. 1634-1637
Author(s):  
Fang Nian Wang ◽  
Shen Shen Wang ◽  
Wan Fang Che ◽  
Yun Bai
Keyword(s):  
Intrusion Detection ◽  
Detection Method ◽  
Attribute Reduction ◽  
Feature Space ◽  
Least Square ◽  
Classification Model ◽  
Network Intrusion Detection ◽  
Support Vector ◽  
Network Intrusion ◽  
Sample Data

An intrusion detection method based on RS-LSSVM is studied in this paper. Firstly, attribute reduction algorithm based on the generalized decision table is proposed to remove the interference features and reduce the dimension of input feature space. Then the classification method based on least square support vector machine (LSSVM) is analyzed. The sample data after dimension reduction is used for LSSVM training, and the LSSVM classification model is obtained, which forms the ability of detecting unknown intrusion. Simulation results show that the proposed method can effectively remove the unnecessary features and improve the performance of network intrusion detection.

scholarly journals Garment Categorization Using Data Mining Techniques

Symmetry ◽  
2020 ◽  
Vol 12 (6) ◽  
pp. 984
Author(s):  
Sheenam Jain ◽  
Vijay Kumar
Keyword(s):  
Data Mining ◽  
Supply Chain ◽  
Random Forest ◽  
Good Deal ◽  
Classification Model ◽  
Upper Body ◽  
Whole Body ◽  
Product Data ◽  
Soft Classification ◽  
Using Data

The apparel industry houses a huge amount and variety of data. At every step of the supply chain, data is collected and stored by each supply chain actor. This data, when used intelligently, can help with solving a good deal of problems for the industry. In this regard, this article is devoted to the application of data mining on the industry’s product data, i.e., data related to a garment, such as fabric, trim, print, shape, and form. The purpose of this article is to use data mining and symmetry-based learning techniques on product data to create a classification model that consists of two subsystems: (1) for predicting the garment category and (2) for predicting the garment sub-category. Classification techniques, such as Decision Trees, Naïve Bayes, Random Forest, and Bayesian Forest were applied to the ‘Deep Fashion’ open-source database. The data contain three garment categories, 50 garment sub-categories, and 1000 garment attributes. The two subsystems were first trained individually and then integrated using soft classification. It was observed that the performance of the random forest classifier was comparatively better, with an accuracy of 86%, 73%, 82%, and 90%, respectively, for the garment category, and sub-categories of upper body garment, lower body garment, and whole-body garment.

A Socially Assistive Robot That Can Interpret Body Language

2011 ◽  
Author(s):  
Derek McColl ◽  
Goldie Nejat
Keyword(s):  
Cognitive Disorder ◽  
Body Language ◽  
Upper Body ◽  
Language Recognition ◽  
Research Issues ◽  
Assistive Robots ◽  
Socially Assistive Robots ◽  
Main Challenge ◽  
Physical Abilities ◽  
Cognitive Therapies

Socially assistive robots can engage in assistive human-robot interactions (HRI) by providing rehabilitation of cognitive, social, and physical abilities after a stroke, accident or diagnosis of a social, developmental or cognitive disorder. However, there are a number of research issues that need to be addressed in order to design such robots. In this paper, we address one main challenge in the development of intelligent socially assistive robots: A robot’s ability to identify human non-verbal communication during assistive interactions. In this paper, we present a unique non-contact automated sensory-based approach for identification and categorization of human upper body language in determining how accessible a person is to a robot during natural real-time HRI. This classification will allow a robot to effectively determine its own reactive task-driven behavior during assistive interactions. The types of interactions envisioned include providing reminders, health monitoring, and social and cognitive therapies. Preliminary experiments show the potential of integrating the proposed body language recognition and classification technique into socially assistive robotic systems partaking in HRI scenarios.

Sign in / Sign up

Export Citation Format

Share Document