scholarly journals Neural Collaborative with Sentence BERT for News Recommender System

2021 ◽  
Vol 5 (4) ◽  
pp. 448
Author(s):  
Budi Juarto ◽  
Abba Suganda Girsang

The number of news produced every day is as much as 3 million per day, making readers have many choices in choosing news according to each reader's topic and category preferences. The recommendation system can make it easier for users to choose the news to read. The method that can be used in providing recommendations from the same user is collaborative filtering. Neural collaborative filtering is usually being used for recommendation systems by combining collaborative filtering with neural networks. However, this method has the disadvantage of recommending the similarity of news content such as news titles and content to users. This research wants to develop neural collaborative filtering using sentences BERT. Sentence BERT is applied to news titles and news contents that are converted into sentence embedding. The results of this sentence embedding are used in neural collaboration with item id, user id, and news category. We use a Microsoft news dataset of 50,000 users and 51,282 news, with 5,475,542 interactions between users and news. The evaluation carried out in this study uses precision, recall, and ROC curves to predict news clicks by the user. Another evaluation uses a hit ratio with the leave one out method. The evaluation results obtained a precision value of 99.14%, recall of 92.48%, f1-score of 95.69%, and ROC score of 98%. Evaluation measurement using the hit ratio@10 produces a hit ratio of 74% at fiftieth epochs for neural collaborative with sentence BERT which is better than neural collaborative filtering (NCF) and NCF with news category.

Author(s):  
S. A. Azeem Farhan

Abstract: The recommendation problem involves the prediction of a set of items that maximize the utility for users. As a solution to this problem, a recommender system is an information filtering system that seeks to predict the rating given by a user to an item. There are theree types of recommendation systesms namely Content based, Collaborative based and the Hybrid based Recommendation systems. The collaborative filtering is further classified into the user based collaborative filtering and item based collaborative filtering. The collaborative filtering (CF) based recommendation systems are capable of grasping the interaction or correlation of users and items under consideration. We have explored most of the existing collaborative filteringbased research on a popular TMDB movie dataset. We found out that some key features were being ignored by most of the previous researches. Our work has given significant importance to 'movie overviews' available in the dataset. We experimented with typical statistical methods like TF-IDF , By using tf-idf the dimensions of our courps(overview and other text features) explodes, which creates problems ,we have tackled those problems using a dimensionality reduction technique named Singular Value Decomposition(SVD). After this preprocessing the Preprocessed data is being used in building the models. We have evaluated the performance of different machine learning algorithms like Random Forest and deep neural networks based BiLSTM. The experiment results provide a reliable model in terms of MAE(mean absolute error) ,RMSE(Root mean squared error) and the Bi-LSTM turns out to be a better model with an MAE of 0.65 and RMSE of 1.04 ,it generates more personalized movie recommendations compared to other models. Keywords: Recommender system, item-based collaborative filtering, Natural Language Processing, Deep learning.


2012 ◽  
Vol 151 ◽  
pp. 576-582 ◽  
Author(s):  
Zhen Jian Yang ◽  
Ke Wen Xia

Presently recommendation systems have gradually become an important part in E-Commerce, more and more research papers about recommendation systems in E-Commerce appeared in many kinds of conferences and journals. With expanding of E-Commerce it also faces series of challenges. Traditional collaborative filtering recommendation technique is hard to provide recommendation service for unregistered users. To overcome this problem, we suggested a framework of recommendation system based on web mining. It is made up of two parts, offline and online. This method first clustered web usage data, web content data and web structure data respectively, then provided high-quality recommendation services based on mining results. Compared with traditional collaborative filtering techniques, recommendation systems based on web mining are convenient for users because user need not to provide user-rating data explicitly. In end of this paper, accuracy of recommendation system based on web mining was tested and compared with traditional collaborative filtering recommendation system. Testing results showed that, quality of recommendation system based on web mining is better than quality of traditional collaborative filtering recommendation system.


2020 ◽  
Vol 24 (6) ◽  
pp. 1477-1496
Author(s):  
Rajalakshmi Sivanaiah ◽  
R. Sakaya Milton ◽  
T.T. Mirnalinee

The main goal of a recommendation system is to recommend items of interest to users by analyzing their historical data. Content-based and collaborative filtering are the traditional recommendation strategies, each with its own strengths and weaknesses. Some of their weaknesses can be overcome by combining the two strategies. The resulting hybrid system performs qualitatively better than the traditional recommendation systems. However, historical data of some users may consist largely of only likes or only dislikes. Those users are termed as optimistic or pessimistic users respectively. On an average there are around 10 to 20% of pessimistic users present in a given dataset. For pessimistic users, whose profiles have mostly dislikes and very few likes, content-based filtering can hardly recommend any items of interest. In content-based filtering technique pessimistic users get poor recommendations of either uninteresting movies or no recommendations at all. This can be alleviated by boosting the content profiles of pessimistic users using the top-n recommendations of collaborative filtering. This content boosted hybrid filtering system provides a novel list of recommendations even for pessimistic users, with predictive accuracy better than that of a traditional content-based filtering system.


2020 ◽  
Vol 14 ◽  
Author(s):  
Amreen Ahmad ◽  
Tanvir Ahmad ◽  
Ishita Tripathi

: The immense growth of information has led to the wide usage of recommender systems for retrieving relevant information. One of the widely used methods for recommendation is collaborative filtering. However, such methods suffer from two problems, scalability and sparsity. In the proposed research, the two issues of collaborative filtering are addressed and a cluster-based recommender system is proposed. For the identification of potential clusters from the underlying network, Shapley value concept is used, which divides users into different clusters. After that, the recommendation algorithm is performed in every respective cluster. The proposed system recommends an item to a specific user based on the ratings of the item’s different attributes. Thus, it reduces the running time of the overall algorithm, since it avoids the overhead of computation involved when the algorithm is executed over the entire dataset. Besides, the security of the recommender system is one of the major concerns nowadays. Attackers can come in the form of ordinary users and introduce bias in the system to force the system function that is advantageous for them. In this paper, we identify different attack models that could hamper the security of the proposed cluster-based recommender system. The efficiency of the proposed research is validated by conducting experiments on student dataset.


Author(s):  
Lakshmikanth Paleti ◽  
P. Radha Krishna ◽  
J.V.R. Murthy

Recommendation systems provide reliable and relevant recommendations to users and also enable users’ trust on the website. This is achieved by the opinions derived from reviews, feedbacks and preferences provided by the users when the product is purchased or viewed through social networks. This integrates interactions of social networks with recommendation systems which results in the behavior of users and user’s friends. The techniques used so far for recommendation systems are traditional, based on collaborative filtering and content based filtering. This paper provides a novel approach called User-Opinion-Rating (UOR) for building recommendation systems by taking user generated opinions over social networks as a dimension. Two tripartite graphs namely User-Item-Rating and User-Item-Opinion are constructed based on users’ opinion on items along with their ratings. Proposed approach quantifies the opinions of users and results obtained reveal the feasibility.


2016 ◽  
Vol 16 (6) ◽  
pp. 245-255 ◽  
Author(s):  
Li Xie ◽  
Wenbo Zhou ◽  
Yaosen Li

Abstract In the era of big data, people have to face information filtration problem. For those cases when users do not or cannot express their demands clearly, recommender system can analyse user’s information more proactive and intelligent to filter out something users want. This property makes recommender system play a very important role in the field of e-commerce, social network and so on. The collaborative filtering recommendation algorithm based on Alternating Least Squares (ALS) is one of common algorithms using matrix factorization technique of recommendation system. In this paper, we design the parallel implementation process of the recommendation algorithm based on Spark platform and the related technology research of recommendation systems. Because of the shortcomings of the recommendation algorithm based on ALS model, a new loss function is designed. Before the model is trained, the similarity information of users and items is fused. The experimental results show that the performance of the proposed algorithm is better than that of algorithm based on ALS.


2021 ◽  
Vol 13 (2) ◽  
pp. 47-53
Author(s):  
M. Abubakar ◽  
K. Umar

Product recommendation systems are information filtering systems that uses ratings and predictions to make new product suggestions. There are many product recommendation system techniques in existence, these include collaborative filtering, content based filtering, knowledge based filtering, utility based filtering and demographic based filtering. Collaborative filtering techniques is known to be the most popular product recommendation system technique. It utilizes user’s previous product ratings to make new product suggestions. However collaborative filtering have some weaknesses, which include cold start, grey sheep issue, synonyms issue. However the major weakness of collaborative filtering approaches is cold user problem. Cold user problem is the failure of product recommendation systems to make product suggestions for new users. Literature investigation had shown that cold user problem could be effectively addressed using active learning technique of administering personalized questionnaire. Unfortunately, the result of personalized questionnaire technique could contain some user preference uncertainties where the product database is too large (as in Amazon). This research work addresses the weakness of personalized questionnaire technique by applying uncertainty reduction strategy to improve the result obtained from administering personalized questionnaire. In our experimental design we perform four different experiments; Personalized questionnaire approach of solving user based coldstart was implemented using Movielens dataset of 1M size, Personalized questionnaire approach of solving user based cold start was implemented using Movielens dataset of 10M size, Personalized questionnaire with uncertainty reduction was implemented using Movielens dataset of 1M size, and also Personalized  questionnaire with uncertainty reduction was implemented using Movielens dataset of 10M size. The experimental result shows RMSE, Precision and Recall improvement of 0.21, 0.17 and 0.18 respectively in 1M dataset and 0.17, 0.14 and 0.20 in 10M dataset respectively over personalized questionnaire.


Author(s):  
Gandhali Malve ◽  
Lajree Lohar ◽  
Tanay Malviya ◽  
Shirish Sabnis

Today the amount of information in the internet growth very rapidly and people need some instruments to find and access appropriate information. One of such tools is called recommendation system. Recommendation systems help to navigate quickly and receive necessary information. Many of us find it difficult to decide which movie to watch and so we decided to make a recommender system for us to better judge which movie we are more likely to love. In this project we are going to use Machine Learning Algorithms to recommend movies to users based on genres and user ratings. Recommendation system attempt to predict the preference or rating that a user would give to an item.


2010 ◽  
Vol 21 (10) ◽  
pp. 1217-1227 ◽  
Author(s):  
WEI ZENG ◽  
MING-SHENG SHANG ◽  
QIAN-MING ZHANG ◽  
LINYUAN LÜ ◽  
TAO ZHOU

Recommender systems are becoming a popular and important set of personalization techniques that assist individual users with navigating through the rapidly growing amount of information. A good recommender system should be able to not only find out the objects preferred by users, but also help users in discovering their personalized tastes. The former corresponds to high accuracy of the recommendation, while the latter to high diversity. A big challenge is to design an algorithm that provides both highly accurate and diverse recommendation. Traditional recommendation algorithms only take into account the contributions of similar users, thus, they tend to recommend popular items for users ignoring the diversity of recommendations. In this paper, we propose a recommendation algorithm by considering both the effects of similar and dissimilar users under the framework of collaborative filtering. Extensive analyses on three datasets, namely MovieLens, Netflix and Amazon, show that our method performs much better than the standard collaborative filtering algorithm for both accuracy and diversity.


Sign in / Sign up

Export Citation Format

Share Document