scholarly journals Relevance judgments between TREC and Non-TREC assessors

2008 ◽  
Author(s):  
Azzah Al-Maskari ◽  
Mark Sanderson ◽  
Paul Clough
Keyword(s):  
Relevance Judgments

The Impact of Negative Relevance Judgments on NDCG

2020 ◽  
Author(s):  
Lukas Gienapp ◽  
Maik Fröbe ◽  
Matthias Hagen ◽  
Martin Potthast
Keyword(s):  
Relevance Judgments ◽  
The Impact

Fuzzy versus probabilistic models for user relevance judgments

1990 ◽  
Vol 41 (4) ◽  
pp. 264-271 ◽  
Author(s):  
Mathew Koll ◽  
Padmini Srinivasan
Keyword(s):  
Probabilistic Models ◽  
Relevance Judgments

Judging the Relevance of Fair Value for Financial Instruments

2011 ◽  
Vol 86 (6) ◽  
pp. 2075-2098 ◽  
Author(s):  
Lisa Koonce ◽  
Karen K. Nelson ◽  
Catherine M. Shakespeare
Keyword(s):  
Value Relevance ◽  
Fair Value ◽  
Data Availability ◽  
Financial Instruments ◽  
Counterfactual Reasoning ◽  
Financial Instrument ◽  
Relevance Judgments

ABSTRACT We conduct three experiments to test if investors' views about fair value are contingent on whether the financial instrument in question is an asset or liability, whether fair values produce gains or losses, and whether the item will or will not be sold/settled soon. We draw on counterfactual reasoning theory from psychology, which suggests that these factors are likely to influence whether investors consider fair value as providing information about forgone opportunities. The latter, in turn, is predicted to influence investors' fair value relevance judgments. Results are generally supportive of the notion that judgments about the relevance of fair value are contingent. Attempts to influence investors' fair value relevance judgments by providing them with information about forgone opportunities are met with mixed success. In particular, our results are sensitive to the type of information provided and indicate the difficulty of overcoming investors' (apparent) strong beliefs about fair value. Data Availability: Contact the authors.

An analysis of human factors and label accuracy in crowdsourcing relevance judgments

2012 ◽  
Vol 16 (2) ◽  
pp. 138-178 ◽  
Author(s):  
Gabriella Kazai ◽  
Jaap Kamps ◽  
Natasa Milic-Frayling
Keyword(s):  
Human Factors ◽  
Relevance Judgments

Reproduce. Generalize. Extend. On Information Retrieval Evaluation without Relevance Judgments

2018 ◽  
Vol 10 (3) ◽  
pp. 1-32 ◽  
Author(s):  
Kevin Roitero ◽  
Marco Passon ◽  
Giuseppe Serra ◽  
Stefano Mizzaro
Keyword(s):  
Information Retrieval ◽  
Information Retrieval Evaluation ◽  
Relevance Judgments
Sign in / Sign up

Export Citation Format

Share Document