The Prediction of the High-Cost Non-Cumulative Discounted Gain and Precision Performance Metrics in Information Retrieval Evaluation

Author(s):  
Sinyinda Muwanei ◽  
Sri Devi Ravana ◽  
Wai Lam Hoo ◽  
Douglas Kunda
2014 ◽  
Vol 48 (1) ◽  
pp. 21-28 ◽  
Author(s):  
Krisztian Balog ◽  
David Elsweiler ◽  
Evangelos Kanoulas ◽  
Liadh Kelly ◽  
Mark D. Smucker

2017 ◽  
Vol 36 (2) ◽  
pp. 1-21 ◽  
Author(s):  
Ellen M. Voorhees ◽  
Daniel Samarov ◽  
Ian Soboroff

2020 ◽  
Vol 38 (4) ◽  
pp. 821-842
Author(s):  
Haihua Chen ◽  
Yunhan Yang ◽  
Wei Lu ◽  
Jiangping Chen

Purpose Citation contexts have been found useful in many scenarios. However, existing context-based recommendations ignored the importance of diversity in reducing the redundant issues and thus cannot cover the broad range of user interests. To address this gap, the paper aims to propose a novelty task that can recommend a set of diverse citation contexts extracted from a list of citing articles. This will assist users in understanding how other scholars have cited an article and deciding which articles they should cite in their own writing. Design/methodology/approach This research combines three semantic distance algorithms and three diversification re-ranking algorithms for the diversifying recommendation based on the CiteSeerX data set and then evaluates the generated citation context lists by applying a user case study on 30 articles. Findings Results show that a diversification strategy that combined “word2vec” and “Integer Linear Programming” leads to better reading experience for participants than other diversification strategies, such as CiteSeerX using a list sorted by citation counts. Practical implications This diversifying recommendation task is valuable for developing better systems in information retrieval, automatic academic recommendations and summarization. Originality/value The originality of the research lies in the proposal of a novelty task that can recommend a diversification context list describing how other scholars cited an article, thereby making citing decisions easier. A novel mixed approach is explored to generate the most efficient diversifying strategy. Besides, rather than traditional information retrieval evaluation, a user evaluation framework is introduced to reflect user information needs more objectively.


Sign in / Sign up

Export Citation Format

Share Document