Evaluating Model Predictive Performance: A Medicare Fraud Detection Case Study

Author(s):  
Richard A. Bauder ◽  
Matthew Herland ◽  
Taghi M. Khoshgoftaar
Author(s):  
Jacqueline Peng ◽  
Mengge Zhao ◽  
James Havrilla ◽  
Cong Liu ◽  
Chunhua Weng ◽  
...  

Abstract Background Natural language processing (NLP) tools can facilitate the extraction of biomedical concepts from unstructured free texts, such as research articles or clinical notes. The NLP software tools CLAMP, cTAKES, and MetaMap are among the most widely used tools to extract biomedical concept entities. However, their performance in extracting disease-specific terminology from literature has not been compared extensively, especially for complex neuropsychiatric disorders with a diverse set of phenotypic and clinical manifestations. Methods We comparatively evaluated these NLP tools using autism spectrum disorder (ASD) as a case study. We collected 827 ASD-related terms based on previous literature as the benchmark list for performance evaluation. Then, we applied CLAMP, cTAKES, and MetaMap on 544 full-text articles and 20,408 abstracts from PubMed to extract ASD-related terms. We evaluated the predictive performance using precision, recall, and F1 score. Results We found that CLAMP has the best performance in terms of F1 score followed by cTAKES and then MetaMap. Our results show that CLAMP has much higher precision than cTAKES and MetaMap, while cTAKES and MetaMap have higher recall than CLAMP. Conclusion The analysis protocols used in this study can be applied to other neuropsychiatric or neurodevelopmental disorders that lack well-defined terminology sets to describe their phenotypic presentations.


Author(s):  
Ojo Samuel ◽  
Alimi Taofeek Ayodele ◽  
Amos Anna Solomon

Mathematical models have been very useful in reducing challenges encountered by researchers due to the inability of having solar radiation data or lack of instrumental sites at every point on the Earth.  This work aimed at investigating the prediction performance of Hargreaves-Samani’s model in estimating global solar radiation (GSR) out of the many other empirical models so far formulated for this purpose. This model basically uses maximum and minimum temperature data and basically used in mid-latitudes. The paper attempts to assess the predictive performance of Hargreaves-Samani’s model in the Savanna region using Yola as a case study. Estimated values of GSR from one month data adopted from the Meteorological station of the Department of Geography, Federal University of Technology, Yola, Nigeria was used for this purpose. Using this model shows a 95% index of agreement (IA) with the observed values; which suggests a good model performance and can also be used in estimating global solar radiation in the Savanna region particularly in areas with little or no such climatic data.


2018 ◽  
Vol 2 (2) ◽  
pp. 175
Author(s):  
Sarina Gabryela Aprilyanti Butar Butar

The purpose of this research is to describe the application of professional skepticism on government internal auditors of the Financial and Development Supervisory Board (BPKP) Representative of Central Java Province in detecting fraud. The application of professional skepticism will be understood based on the characters of attitude, as stated by Hurtt (2010), consisting of questioning mind, suspension on judgment, search for knowledge, interpersonal understanding, self-confidence, and selfdetermination.This research is conducted using qualitative approach and refers to theoretical proposition. The data was collected by interviewing forensic auditors at each of functional position. The interviewees were determined by using purposive sampling method. They were forensic auditors who had ever been sued for audit report. The result shows that the forensic auditors of BPKP Representative of Central Java have already had proper comprehension about professional skepticism in fraud detection. The forensic auditors of BPKP Representative of Central Java have also applied professional skepticism in detecting fraud.


2019 ◽  
Vol 887 ◽  
pp. 401-407
Author(s):  
Samira Aien ◽  
Mahnameh Taheri ◽  
Sarin Pinich ◽  
Matthias Schuss ◽  
Ardeshir Mahdavi

In recent years, many researchers have focused on the energy efficiency and performance of existing buildings. In order to predict the hygrothermal performance and minimize the risk of moisture damage in retrofit cases, user-friendly moisture calculation tools have been developed. However, concerns have been raised as to how to increase the reliability of such tools. In this context, the present study uses simulation to investigate the retrofit potential of the historical building façades via application of silica aerogels on the external walls. Monitored data provided the basis for generation of a more accurate initial simulation model, as well as the evaluation of the predictive performance of the model.


Sign in / Sign up

Export Citation Format

Share Document