Product click-through rate prediction model integrating self-attention mechanism

Author(s):  
Tong Zhu ◽  
Shuqin Li ◽  
Chunquan Liang ◽  
Bin Liu ◽  
Xiaopeng Li
2021 ◽  
Vol 2113 (1) ◽  
pp. 012010
Author(s):  
Lu Meng ◽  
Li Wang

Abstract With the continuous increase of web resources, information overload is becoming more and more serious. Getting the information that meets the needs of a large amount of data has become an urgent problem. One of the popular studies in click-through rate prediction is to construct feature interactions to improve prediction accuracy. Traditional models with low-order interactions cannot adequately represent the intersection information, and deep models with undifferentiated feature intersections lack relevance. In this paper, we propose a model called SELNN, which improves the accuracy of click-through rate prediction through attention mechanism and logarithmic conversion. On the one hand, improving attention mechanisms learns the importance of each feature itself. On the other hand, combining logarithmic conversion structure with feedforward neural networks to learn different orders of feature interactions. The experimental results indicated that the AUC values of SELNN on the Criteo and Movielens-1M datasets were 81.46% and 87.36%, respectively. SELNN effectively improves the prediction accuracy and reduces the number of parameters and computational effort.


2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Danqing Zhu

In the era of big data information, how to effectively predict and analyze the click-through rate of information advertising is the key for enterprises in various fields to seek returns. The point rate prediction of advertising is one of the core contents of advertising calculation. The traditional shallow prediction model cannot meet the nonlinear relationship of data processing, and the manual processing of data information extraction method is very resource consuming. To solve the above problems, this paper proposes a CNN-LSTM (convolutional neural network-long short-term memory) convolution hybrid neural network algorithm to predict the click-through rate of advertisements. According to the neural network algorithm, the prediction model is constructed, and the effective features are extracted in the process of model establishment, and the prediction analysis is carried out according to the simplified LSTM neural network time serialization features. CNN convolution neural network is used to train the prediction model. This paper analyzes the characteristics of traditional prediction methods and the corresponding solutions and carries out feature learning and prediction model construction for advertising click-through rate prediction. Then, the unknown behavior of advertising users is judged and predicted. The results show that, compared with the single structure network of traditional prediction model, the prediction effect based on CNN-LSTM neural network algorithm has higher accuracy.


2021 ◽  
Vol 216 ◽  
pp. 106767
Author(s):  
Kaitao Song ◽  
Qingkang Huang ◽  
Fa-en Zhang ◽  
Jianfeng Lu

Sign in / Sign up

Export Citation Format

Share Document