scholarly journals Quantifying Social Biases in NLP: A Generalization and Empirical Comparison of Extrinsic Fairness Metrics

2021 ◽  
Vol 9 ◽  
pp. 1249-1267
Author(s):  
Paula Czarnowska ◽  
Yogarshi Vyas ◽  
Kashif Shah

Abstract Measuring bias is key for better understanding and addressing unfairness in NLP/ML models. This is often done via fairness metrics, which quantify the differences in a model’s behaviour across a range of demographic groups. In this work, we shed more light on the differences and similarities between the fairness metrics used in NLP. First, we unify a broad range of existing metrics under three generalized fairness metrics, revealing the connections between them. Next, we carry out an extensive empirical comparison of existing metrics and demonstrate that the observed differences in bias measurement can be systematically explained via differences in parameter choices for our generalized metrics.

2020 ◽  
Author(s):  
Qi Wang ◽  
Hee Jin Jeon

Biases perpetuate when people think that they are innocent whereas others are guilty of biases. We examined whether people would detect biased thinking and behavior in others but not themselves as influenced by preexisting beliefs (myside bias) and social stigmas (social biases). The results of three large studies showed that, across demographic groups, participants attributed more biases to others than to themselves and that this self-other asymmetry was particularly salient among those who hold strong beliefs about the existence of biases (Study 1 and Study 2). The self-other asymmetry in bias recognition dissipated when participants made simultaneous predictions about others’ and their own thoughts and behaviors (Study 3). People thus exhibit bias in bias recognition and this metacognitive bias may be remedied by highlighting to people that we are all susceptible to biasing influences.


Author(s):  
Debi A. LaPlante ◽  
Heather M. Gray ◽  
Pat M. Williams ◽  
Sarah E. Nelson

Abstract. Aims: To discuss and review the latest research related to gambling expansion. Method: We completed a literature review and empirical comparison of peer reviewed findings related to gambling expansion and subsequent gambling-related changes among the population. Results: Although gambling expansion is associated with changes in gambling and gambling-related problems, empirical studies suggest that these effects are mixed and the available literature is limited. For example, the peer review literature suggests that most post-expansion gambling outcomes (i. e., 22 of 34 possible expansion outcomes; 64.7 %) indicate no observable change or a decrease in gambling outcomes, and a minority (i. e., 12 of 34 possible expansion outcomes; 35.3 %) indicate an increase in gambling outcomes. Conclusions: Empirical data related to gambling expansion suggests that its effects are more complex than frequently considered; however, evidence-based intervention might help prepare jurisdictions to deal with potential consequences. Jurisdictions can develop and evaluate responsible gambling programs to try to mitigate the impacts of expanded gambling.


Crisis ◽  
2009 ◽  
Vol 30 (4) ◽  
pp. 180-185 ◽  
Author(s):  
Evertjan Jansen ◽  
Marcel C.A. Buster ◽  
Annemarie L. Zuur ◽  
Cees Das

Background: According to recent figures, Amsterdam is the municipality with the highest absolute number of suicides and the second highest suicide rate in the Netherlands. Aims: The aim of the study was to identify time trends and demographic differences in the occurrence of nonfatal suicide attempts versus suicides. Methods: We used registrations of forensic physicians and ambulance services of the Municipal Health Service of Amsterdam to study 1,004 suicides and 6,166 nonfatal attempts occurring in Amsterdam over the period 1996–2005. Results: The number of nonfatal attempts declined from 1996 to 2005, but the number of completed suicides remained relatively stable. Although case fatality was strongly associated with method used, we also found higher case fatalities for men and older people independent of method. Conclusions: The case fatality results suggest differences in motive among different demographic groups: possibly the wish to die is stronger among men and elderly. This finding had implications for the success to be expected from different preventive measures.


2019 ◽  
Vol 45 (7) ◽  
pp. 1151-1165 ◽  
Author(s):  
Antonia Krefeld-Schwalb ◽  
Chris Donkin ◽  
Ben R. Newell ◽  
Benjamin Scheibehenne

Author(s):  
Galyna Zhukova

Growing problem of inconsistency of the academic system of education with the new needs of society and individual, lack of existing structures of education contribute to the emergence of a different approach for the organization of educational activities, which is non-academic. As a philosophical phenomenon, it fully complies with the students' diverse interests and possibilities. Nonacademic education functions outside the academic education, free from strict rules and regulations, it focuses on specific educational requests of different social, professional, demographic groups.


2020 ◽  
Author(s):  
Kristina Nelson ◽  
Matt Honore ◽  
Jen Lindwall ◽  
Arjun Viray ◽  
Lisa Marriott ◽  
...  

In April 2020, at the onset of COVID-19 in the U.S., we implemented a weekly survey of underrepresented undergraduate students participating in a biomedical research training program. The 10-week survey collected qualitative and quantitative data on mental health, physical health, and financial health. Responses indicated high stress during the pandemic, particularly during the survey’s final weeks which occurred during a period of social unrest. Physical health declined throughout the survey, stabilizing in its final weeks. Financial health declined initially and stayed low throughout. Students from certain demographic groups, such as first generation college students and those with dependents were disproportionately impacted. Qualitative responses highlighted the intersectionality of the three constructs and illustrated the impacts of these events.


Sign in / Sign up

Export Citation Format

Share Document