scholarly journals Attention neural collaboration filtering based on GRU for recommender systems

2021 ◽  
Author(s):  
Hongbin Xia ◽  
Yang Luo ◽  
Yuan Liu
Keyword(s):  
Deep Learning ◽  
Collaborative Filtering ◽  
Recommendation System ◽  
Auxiliary Information ◽  
User Preferences ◽  
Feature Representation ◽  
Long Distance ◽  
Data Set ◽  
Filtering Method ◽  
The Impact

AbstractThe collaborative filtering method is widely used in the traditional recommendation system. The collaborative filtering method based on matrix factorization treats the user’s preference for the item as a linear combination of the user and the item latent vectors, and cannot learn a deeper feature representation. In addition, the cold start and data sparsity remain major problems for collaborative filtering. To tackle these problems, some scholars have proposed to use deep neural network to extract text information, but did not consider the impact of long-distance dependent information and key information on their models. In this paper, we propose a neural collaborative filtering recommender method that integrates user and item auxiliary information. This method fully integrates user-item rating information, user assistance information and item text assistance information for feature extraction. First, Stacked Denoising Auto Encoder is used to extract user features, and Gated Recurrent Unit with auxiliary information is used to extract items’ latent vectors, respectively. The attention mechanism is used to learn key information when extracting text features. Second, the latent vectors learned by deep learning techniques are used in multi-layer nonlinear networks to learn more abstract and deeper feature representations to predict user preferences. According to the verification results on the MovieLens data set, the proposed model outperforms other traditional approaches and deep learning models making it state of the art.

scholarly journals Recommendation System for Purchasing Goods Based on the Decision Tree Algorithm

2021 ◽  
Vol 6 (2) ◽  
pp. 121-127
Author(s):  
Yurii Kohut ◽  
◽  
Iryna Yurchak
Keyword(s):  
Collaborative Filtering ◽  
Recommendation System ◽  
Recommendation Systems ◽  
Preference Profile ◽  
Final Decision ◽  
Filtering Method ◽  
Binary Descriptors ◽  
Short Period ◽  
The Impact ◽  
Content Based Filtering

Over the past few years, interest in applications related to recommendation systems has increased significantly. Many modern services create recommendation systems that, based on user profile information and his behavior. This services determine which objects or products may be interesting to users. Recommendation systems are a modern tool for understanding customer needs. The main methods of constructing recommendation systems are the content-based filtering method and the collaborative filtering method. This article presents the implementation of these methods based on decision trees. The content-based filtering method is based on the description of the object and the customer’s preference profile. An object description is a finite set of its descriptors, such as keywords, binary descriptors, etc., and a preference profile is a weighted vector of object descriptors in which scales reflect the importance of each descriptor to the client and its contribution to the final decision. This model selects items that are similar to the customer’s favorite items before. The second model, which implements the method of collaborative filtering, is based on information about the history of behavior of all customers on the resource: data on their purchases, assessments of product quality, reviews, marked product. The model finds clients that are similar in behavior and the recommendation is based on their assessments of this element. Voting was used to combine the results issued by individual models — the best result is chosen from the results of two models of the ensemble. This approach minimizes the impact of randomness and averages the errors of each model. The aim: The purpose of work is to create real competitive recommendation system for short period of time and minimum costs.

scholarly journals ClothNet: A Neural Network Based Recommender System

2020 ◽  
Author(s):  
Hao Xing ◽  
Zhike Han ◽  
Yichen Shen
Keyword(s):  
Neural Network ◽  
Collaborative Filtering ◽  
Visual Information ◽  
Recommendation System ◽  
User Preferences ◽  
Fashion Industry ◽  
Training Mode ◽  
Time Changes ◽  
The Impact ◽  
Cold Start Problem

The traditional collaborative filtering recommendation systems have many deficiencies, which make them incompetent in the domain of clothing recommendation; we proposed a new ClothNet model based on CNN, RNN, collaborative filtering and the characteristics of the fashion industry. The accuracy and generalization performance of this model are improved compared with traditional systems. The visual information integrated into the ClothNet model enables the recommendation system to alleviate the cold start problem, and new clothes can be added to the recommendation list faster through the visual information. The addition of temporal information enables ClothNet sharply capturing the impact of seasonal and time changes on user preferences. However, because RNN and CNN have the disadvantage of requiring a large amount of data, combining RNN and CNN will make the model more difficult to converge, so we have adopted the LearningToRank training mode and obtained good results.

scholarly journals Investigating the impact of pre-processing techniques and pre-trained word embeddings in detecting Arabic health information on social media

2021 ◽  
Vol 8 (1) ◽  
Author(s):  
Yahya Albalawi ◽  
Jim Buckley ◽  
Nikola S. Nikolov
Keyword(s):  
Social Media ◽  
Deep Learning ◽  
Comprehensive Evaluation ◽  
Classification Problem ◽  
Data Sets ◽  
Word Embeddings ◽  
Data Set ◽  
Lower Accuracy ◽  
Health Related ◽  
The Impact

AbstractThis paper presents a comprehensive evaluation of data pre-processing and word embedding techniques in the context of Arabic document classification in the domain of health-related communication on social media. We evaluate 26 text pre-processings applied to Arabic tweets within the process of training a classifier to identify health-related tweets. For this task we use the (traditional) machine learning classifiers KNN, SVM, Multinomial NB and Logistic Regression. Furthermore, we report experimental results with the deep learning architectures BLSTM and CNN for the same text classification problem. Since word embeddings are more typically used as the input layer in deep networks, in the deep learning experiments we evaluate several state-of-the-art pre-trained word embeddings with the same text pre-processing applied. To achieve these goals, we use two data sets: one for both training and testing, and another for testing the generality of our models only. Our results point to the conclusion that only four out of the 26 pre-processings improve the classification accuracy significantly. For the first data set of Arabic tweets, we found that Mazajak CBOW pre-trained word embeddings as the input to a BLSTM deep network led to the most accurate classifier with F1 score of 89.7%. For the second data set, Mazajak Skip-Gram pre-trained word embeddings as the input to BLSTM led to the most accurate model with F1 score of 75.2% and accuracy of 90.7% compared to F1 score of 90.8% achieved by Mazajak CBOW for the same architecture but with lower accuracy of 70.89%. Our results also show that the performance of the best of the traditional classifier we trained is comparable to the deep learning methods on the first dataset, but significantly worse on the second dataset.

Song Recommendations Based on Artists with Cosine Similarity Algorithms and K-Nearest Neighbor

2020 ◽  
Vol 8 (4) ◽  
pp. 367
Author(s):  
Muhammad Arief Budiman ◽  
Gst. Ayu Vida Mastrika Giri
Keyword(s):  
Collaborative Filtering ◽  
Mobile Phones ◽  
Recommendation System ◽  
Nearest Neighbor ◽  
Cosine Similarity ◽  
Music Recommendation ◽  
K Nearest Neighbor ◽  
Filtering Method ◽  
K Nearest Neighbor Algorithm ◽  
Music Recommendation System

The development of the music industry is currently growing rapidly, millions of music works continue to be issued by various music artists. As for the technologies also follows these developments, examples are mobile phones applications that have music subscription services, namely Spotify, Joox, GrooveShark, and others. Application-based services are increasingly in demand by users for streaming music, free or paid. In this paper, a music recommendation system is proposed, which the system itself can recommend songs based on the similarity of the artist that the user likes or has heard. This research uses Collaborative Filtering method with Cosine Similarity and K-Nearest Neighbor algorithm. From this research, a system that can recommend songs based on artists who are related to one another is generated.

Automatic Deep Learning-Based Consolidation/Collapse Classification in Lung Ultrasound Images for COVID-19 Induced Pneumonia

2022 ◽  
Author(s):  
Nabeel Durrani ◽  
Damjan Vukovic ◽  
Maria Antico ◽  
Jeroen van der Burgt ◽  
Ruud JG van van Sloun ◽  
...  
Keyword(s):  
Deep Learning ◽  
Class Imbalance ◽  
Ultrasound Images ◽  
Pleural Effusions ◽  
Data Set ◽  
Label Noise ◽  
Set Size ◽  
Video Frames ◽  
Two Factors ◽  
The Impact

<div>Our automated deep learning-based approach identifies consolidation/collapse in LUS images to aid in the diagnosis of late stages of COVID-19 induced pneumonia, where consolidation/collapse is one of the possible associated pathologies. A common challenge in training such models is that annotating each frame of an ultrasound video requires high labelling effort. This effort in practice becomes prohibitive for large ultrasound datasets. To understand the impact of various degrees of labelling precision, we compare labelling strategies to train fully supervised models (frame-based method, higher labelling effort) and inaccurately supervised models (video-based methods, lower labelling effort), both of which yield binary predictions for LUS videos on a frame-by-frame level. We moreover introduce a novel sampled quaternary method which randomly samples only 10% of the LUS video frames and subsequently assigns (ordinal) categorical labels to all frames in the video based on the fraction of positively annotated samples. This method outperformed the inaccurately supervised video-based method of our previous work on pleural effusions. More surprisingly, this method outperformed the supervised frame-based approach with respect to metrics such as precision-recall area under curve (PR-AUC) and F1 score that are suitable for the class imbalance scenario of our dataset despite being a form of inaccurate learning. This may be due to the combination of a significantly smaller data set size compared to our previous work and the higher complexity of consolidation/collapse compared to pleural effusion, two factors which contribute to label noise and overfitting; specifically, we argue that our video-based method is more robust with respect to label noise and mitigates overfitting in a manner similar to label smoothing. Using clinical expert feedback, separate criteria were developed to exclude data from the training and test sets respectively for our ten-fold cross validation results, which resulted in a PR-AUC score of 73% and an accuracy of 89%. While the efficacy of our classifier using the sampled quaternary method must be verified on a larger consolidation/collapse dataset, when considering the complexity of the pathology, our proposed classifier using the sampled quaternary video-based method is clinically comparable with trained experts and improves over the video-based method of our previous work on pleural effusions.</div>

scholarly journals Collaborative Filtering Recommendation Algorithm Based on TF-IDF and User Characteristics

2021 ◽  
Vol 11 (20) ◽  
pp. 9554
Author(s):  
Jianjun Ni ◽  
Yu Cai ◽  
Guangyi Tang ◽  
Yingjuan Xie
Keyword(s):  
Collaborative Filtering ◽  
User Characteristics ◽  
Recommendation Algorithm ◽  
Data Set ◽  
Rating Data ◽  
User Similarity ◽  
Public Data ◽  
Weighted Algorithm ◽  
Collaborative Filtering Algorithm ◽  
The Impact

The recommendation algorithm is a very important and challenging issue for a personal recommender system. The collaborative filtering recommendation algorithm is one of the most popular and effective recommendation algorithms. However, the traditional collaborative filtering recommendation algorithm does not fully consider the impact of popular items and user characteristics on the recommendation results. To solve these problems, an improved collaborative filtering algorithm is proposed, which is based on the Term Frequency-Inverse Document Frequency (TF-IDF) method and user characteristics. In the proposed algorithm, an improved TF-IDF method is used to calculate the user similarity on the basis of rating data first. Secondly, the multi-dimensional characteristics information of users is used to calculate the user similarity by a fuzzy membership method. Then, the above two user similarities are fused based on an adaptive weighted algorithm. Finally, some experiments are conducted on the movie public data set, and the experimental results show that the proposed method has better performance than that of the state of the art.

scholarly journals Deep-Learning-Based Detection of Infants with Autism Spectrum Disorder Using Auto-Encoder Feature Representation

Sensors ◽  
2020 ◽  
Vol 20 (23) ◽  
pp. 6762
Author(s):  
Jung Hyuk Lee ◽  
Geon Woo Lee ◽  
Guiyoung Bong ◽  
Hee Jeong Yoo ◽  
Hong Kook Kim
Keyword(s):  
Autism Spectrum Disorder ◽  
Feature Extraction ◽  
Deep Learning ◽  
Autism Spectrum ◽  
Feature Representation ◽  
Diagnostic Methods ◽  
Spectrum Disorder ◽  
Joint Optimization ◽  
Data Set ◽  
Children With Asd

Autism spectrum disorder (ASD) is a developmental disorder with a life-span disability. While diagnostic instruments have been developed and qualified based on the accuracy of the discrimination of children with ASD from typical development (TD) children, the stability of such procedures can be disrupted by limitations pertaining to time expenses and the subjectivity of clinicians. Consequently, automated diagnostic methods have been developed for acquiring objective measures of autism, and in various fields of research, vocal characteristics have not only been reported as distinctive characteristics by clinicians, but have also shown promising performance in several studies utilizing deep learning models based on the automated discrimination of children with ASD from children with TD. However, difficulties still exist in terms of the characteristics of the data, the complexity of the analysis, and the lack of arranged data caused by the low accessibility for diagnosis and the need to secure anonymity. In order to address these issues, we introduce a pre-trained feature extraction auto-encoder model and a joint optimization scheme, which can achieve robustness for widely distributed and unrefined data using a deep-learning-based method for the detection of autism that utilizes various models. By adopting this auto-encoder-based feature extraction and joint optimization in the extended version of the Geneva minimalistic acoustic parameter set (eGeMAPS) speech feature data set, we acquire improved performance in the detection of ASD in infants compared to the raw data set.

A Novel Deep Learning-Based Collaborative Filtering Model for Recommendation System

2019 ◽  
Vol 49 (3) ◽  
pp. 1084-1096 ◽  
Author(s):  
Mingsheng Fu ◽  
Hong Qu ◽  
Zhang Yi ◽  
Li Lu ◽  
Yongsheng Liu
Keyword(s):  
Deep Learning ◽  
Collaborative Filtering ◽  
Recommendation System

scholarly journals Cognitive Similarity-Based Collaborative Filtering Recommendation System

2020 ◽  
Vol 10 (12) ◽  
pp. 4183 ◽  
Author(s):  
Luong Vuong Nguyen ◽  
Min-Sung Hong ◽  
Jason J. Jung ◽  
Bong-Soo Sohn
Keyword(s):  
Performance Evaluation ◽  
Collaborative Filtering ◽  
Similarity Measure ◽  
Recommendation System ◽  
Pearson Correlation ◽  
Cognitive Network ◽  
Data Set ◽  
New Approach ◽  
Layered Architecture ◽  
F Measure

This paper provides a new approach that improves collaborative filtering results in recommendation systems. In particular, we aim to ensure the reliability of the data set collected which is to collect the cognition about the item similarity from the users. Hence, in this work, we collect the cognitive similarity of the user about similar movies. Besides, we introduce a three-layered architecture that consists of the network between the items (item layer), the network between the cognitive similarity of users (cognition layer) and the network between users occurring in their cognitive similarity (user layer). For instance, the similarity in the cognitive network can be extracted from a similarity measure on the item network. In order to evaluate our method, we conducted experiments in the movie domain. In addition, for better performance evaluation, we use the F-measure that is a combination of two criteria P r e c i s i o n and R e c a l l . Compared with the Pearson Correlation, our method more accurate and achieves improvement over the baseline 11.1% in the best case. The result shows that our method achieved consistent improvement of 1.8% to 3.2% for various neighborhood sizes in MAE calculation, and from 2.0% to 4.1% in RMSE calculation. This indicates that our method improves recommendation performance.

scholarly journals Machine Learning as a method of adapting offers to the clients

2019 ◽  
Vol 13 ◽  
pp. 267-271
Author(s):  
Jacek Bielecki ◽  
Oskar Ceglarski ◽  
Maria Skublewska-Paszkowska
Keyword(s):  
Machine Learning ◽  
Collaborative Filtering ◽  
Recommendation System ◽  
Recommendation Systems ◽  
Filtering Method ◽  
Advantages And Disadvantages ◽  
Information Filter ◽  
User Ratings ◽  
Research Show

Recommendation systems are class of information filter applications whose main goal is to provide personalized recommendations. The main goal of the research was to compare two ways of creating personalized recommendations. The recommendation system was built on the basis of a content-based cognitive filtering method and on the basis of a collaborative filtering method based on user ratings. The conclusions of the research show the advantages and disadvantages of both methods.

Sign in / Sign up

Export Citation Format

Share Document