scholarly journals Inferring Emotion Tags from Object Images Using Convolutional Neural Network

2020 ◽  
Vol 10 (15) ◽  
pp. 5333
Author(s):  
Anam Manzoor ◽  
Waqar Ahmad ◽  
Muhammad Ehatisham-ul-Haq ◽  
Abdul Hannan ◽  
Muhammad Asif Khan ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Human Behavior ◽  
Real Life ◽  
Vital Role ◽  
Object Categories ◽  
Different Types ◽  
Gender Based ◽  
High Level ◽  
Human Behavior Analysis

Emotions are a fundamental part of human behavior and can be stimulated in numerous ways. In real-life, we come across different types of objects such as cake, crab, television, trees, etc., in our routine life, which may excite certain emotions. Likewise, object images that we see and share on different platforms are also capable of expressing or inducing human emotions. Inferring emotion tags from these object images has great significance as it can play a vital role in recommendation systems, image retrieval, human behavior analysis and, advertisement applications. The existing schemes for emotion tag perception are based on the visual features, like color and texture of an image, which are poorly affected by lightning conditions. The main objective of our proposed study is to address this problem by introducing a novel idea of inferring emotion tags from the images based on object-related features. In this aspect, we first created an emotion-tagged dataset from the publicly available object detection dataset (i.e., “Caltech-256”) using subject evaluation from 212 users. Next, we used a convolutional neural network-based model to automatically extract the high-level features from object images for recognizing nine (09) emotion categories, such as amusement, awe, anger, boredom, contentment, disgust, excitement, fear, and sadness. Experimental results on our emotion-tagged dataset endorse the success of our proposed idea in terms of accuracy, precision, recall, specificity, and F1-score. Overall, the proposed scheme achieved an accuracy rate of approximately 85% and 79% using top-level and bottom-level emotion tagging, respectively. We also performed a gender-based analysis for inferring emotion tags and observed that male and female subjects have discernment in emotions perception concerning different object categories.

scholarly journals Analysis of Brain Tumor Disease Detection Using Convolutional Neural Network

2021 ◽  
Author(s):  
Yogesh Deshmukh ◽  
Samiksha Dahe ◽  
Tanmayeeta Belote ◽  
Aishwarya Gawali ◽  
Sunnykumar Choudhary
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Brain Tumor ◽  
Human Brain ◽  
Convolutional Neural Network ◽  
Learning Algorithm ◽  
Vital Role ◽  
Machine Learning Algorithm ◽  
Different Types ◽  
The Brain

Brain Tumor detection using Convolutional Neural Network (CNN) is used to discover and classify the types of Tumor. Over a amount of years, many researchers are researched and planned ways throughout this area. We’ve proposed a technique that’s capable of detecting and classifying different types of tumor. For detecting and classifying tumor we have used MRI because MRI images gives the complete structure of the human brain, without any operation it scans the human brain and this helps in processing of image for the detection of the Tumor. The prediction of tumor by human from the MRI images leads to misclassification. This motivates us to construct the algorithm for detection of the brain tumor. Machine learning helps and plays a vital role in detecting tumor. In this paper, we tend to use one among the machine learning algorithm i.e. Convolutional neural network (CNN), as CNNs are powerful in image processing and with the help of CNN and MRI images we designed a framework for detection of the brain tumor and classifying its Different types.

scholarly journals Methods for Preventing Visual Attacks in Convolutional Neural Networks Based on Data Discard and Dimensionality Reduction

2021 ◽  
Vol 11 (11) ◽  
pp. 5235
Author(s):  
Nikita Andriyanov
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Network Inference ◽  
Recognition Accuracy ◽  
Network Architectures ◽  
Reduced Dimensions ◽  
Different Types ◽  
Rectangular Area ◽  
Noise Impulse ◽  
Selection Of

The article is devoted to the study of convolutional neural network inference in the task of image processing under the influence of visual attacks. Attacks of four different types were considered: simple, involving the addition of white Gaussian noise, impulse action on one pixel of an image, and attacks that change brightness values within a rectangular area. MNIST and Kaggle dogs vs. cats datasets were chosen. Recognition characteristics were obtained for the accuracy, depending on the number of images subjected to attacks and the types of attacks used in the training. The study was based on well-known convolutional neural network architectures used in pattern recognition tasks, such as VGG-16 and Inception_v3. The dependencies of the recognition accuracy on the parameters of visual attacks were obtained. Original methods were proposed to prevent visual attacks. Such methods are based on the selection of “incomprehensible” classes for the recognizer, and their subsequent correction based on neural network inference with reduced image sizes. As a result of applying these methods, gains in the accuracy metric by a factor of 1.3 were obtained after iteration by discarding incomprehensible images, and reducing the amount of uncertainty by 4–5% after iteration by applying the integration of the results of image analyses in reduced dimensions.

scholarly journals Image Registration Algorithm Based on Convolutional Neural Network and Local Homography Transformation

2020 ◽  
Vol 10 (3) ◽  
pp. 732 ◽  
Author(s):  
Yuanwei Wang ◽  
Mei Yu ◽  
Gangyi Jiang ◽  
Zhiyong Pan ◽  
Jiqiang Lin
Keyword(s):  
Neural Network ◽  
Image Registration ◽  
Convolutional Neural Network ◽  
Estimation Algorithm ◽  
Matrix Estimation ◽  
Registration Algorithm ◽  
Image Registration Algorithm ◽  
Different Types ◽  
Homography Transformation ◽  
Traditional Image

In order to overcome the poor robustness of traditional image registration algorithms in illuminating and solving the problem of low accuracy of a learning-based image homography matrix estimation algorithm, an image registration algorithm based on convolutional neural network (CNN) and local homography transformation is proposed. Firstly, to ensure the diversity of samples, a sample and label generation method based on moving direct linear transformation (MDLT) is designed. The generated samples and labels can effectively reflect the local characteristics of images and are suitable for training the CNN model with which multiple pairs of local matching points between two images to be registered can be calculated. Then, the local homography matrices between the two images are estimated by using the MDLT and finally the image registration can be realized. The experimental results show that the proposed image registration algorithm achieves higher accuracy than other commonly used algorithms such as the SIFT, ORB, ECC, and APAP algorithms, as well as another two learning-based algorithms, and it has good robustness for different types of illumination imaging.

Convolutional neural network for human behavior recognition based on smart bracelet

2020 ◽  
Vol 38 (5) ◽  
pp. 5615-5626
Author(s):  
Junsuo Qu ◽  
Ning Qiao ◽  
Haonan Shi ◽  
Chang Su ◽  
Abolfazl Razi
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Human Behavior ◽  
Behavior Recognition ◽  
Human Behavior Recognition

scholarly journals Convolutional Neural Network for Track Seed Filtering at the CMS High-Level Trigger

2018 ◽  
Vol 1085 ◽  
pp. 042040
Author(s):  
Adriano Di Florio ◽  
Felice Pantaleo ◽  
Antonio Carta ◽  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Level Trigger ◽  
High Level

scholarly journals Deep Learning-Based Classification of Weld Surface Defects

2019 ◽  
Vol 9 (16) ◽  
pp. 3312 ◽  
Author(s):  
Zhu ◽  
Ge ◽  
Liu
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Random Forest ◽  
Convolutional Neural Network ◽  
Surface Defects ◽  
Recognition Method ◽  
High Level ◽  
Intelligent Recognition ◽  
Non Destructive

In order to realize the non-destructive intelligent identification of weld surface defects, an intelligent recognition method based on deep learning is proposed, which is mainly formed by convolutional neural network (CNN) and forest random. First, the high-level features are automatically learned through the CNN. Random forest is trained with extracted high-level features to predict the classification results. Secondly, the weld surface defects images are collected and preprocessed by image enhancement and threshold segmentation. A database of weld surface defects is established using pre-processed images. Finally, comparative experiments are performed on the weld surface defects database. The results show that the accuracy of the method combined with CNN and random forest can reach 0.9875, and it also demonstrates the method is effective and practical.

scholarly journals A High-Density Crowd Counting Method Based on Convolutional Feature Fusion

2018 ◽  
Vol 8 (12) ◽  
pp. 2367 ◽  
Author(s):  
Hongling Luo ◽  
Jun Sang ◽  
Weiqun Wu ◽  
Hong Xiang ◽  
Zhili Xiang ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Large Scale ◽  
Feature Fusion ◽  
High Density ◽  
Counting Problem ◽  
Crowd Counting ◽  
Low Level ◽  
Density Map ◽  
High Level

In recent years, the trampling events due to overcrowding have occurred frequently, which leads to the demand for crowd counting under a high-density environment. At present, there are few studies on monitoring crowds in a large-scale crowded environment, while there exists technology drawbacks and a lack of mature systems. Aiming to solve the crowd counting problem with high-density under complex environments, a feature fusion-based deep convolutional neural network method FF-CNN (Feature Fusion of Convolutional Neural Network) was proposed in this paper. The proposed FF-CNN mapped the crowd image to its crowd density map, and then obtained the head count by integration. The geometry adaptive kernels were adopted to generate high-quality density maps which were used as ground truths for network training. The deconvolution technique was used to achieve the fusion of high-level and low-level features to get richer features, and two loss functions, i.e., density map loss and absolute count loss, were used for joint optimization. In order to increase the sample diversity, the original images were cropped with a random cropping method for each iteration. The experimental results of FF-CNN on the ShanghaiTech public dataset showed that the fusion of low-level and high-level features can extract richer features to improve the precision of density map estimation, and further improve the accuracy of crowd counting.

Sign in / Sign up

Export Citation Format

Share Document