scholarly journals A Quality Framework for Statistics based on Administrative Data Sources using the Example of the Austrian Census 2011

2016 ◽  
Vol 39 (4) ◽  
Author(s):  
Christopher Berka ◽  
Stefan Humer ◽  
Manuela Lenk ◽  
Mathias Moser ◽  
Henrik Rechta ◽  
...  

Along with the implementation of a register-based census we develop a methodological framework to assess administrative data sources for statistical use. Key aspects for the quality of these data are identified in the context of hyperdimensions and embedded into a process flow. Based on this approach we develop a structural quality framework and suggest a concept for quality assessment and several quality measures.

Author(s):  
Catherine Eastwood ◽  
Keith Denny ◽  
Maureen Kelly ◽  
Hude Quan

Theme: Data and Linkage QualityObjectives: To define health data quality from clinical, data science, and health system perspectives To describe some of the international best practices related to quality and how they are being applied to Canada’s administrative health data. To compare methods for health data quality assessment and improvement in Canada (automated logical checks, chart quality indicators, reabstraction studies, coding manager perspectives) To highlight how data linkage can be used to provide new insights into the quality of original data sources To highlight current international initiatives for improving coded data quality including results from current ICD-11 field trials Dr. Keith Denny: Director of Clinical Data Standards and Quality, Canadian Insititute for Health Information (CIHI), Adjunct Research Professor, Carleton University, Ottawa, ON. He provides leadership for CIHI’s information quality initiatives and for the development and application of clinical classifications and terminology standards. Maureen Kelly: Manager of Information Quality at CIHI, Ottawa, ON. She leads CIHI’s corporate quality program that is focused on enhancing the quality of CIHI’s data sources and information products and to fostering CIHI’s quality culture. Dr. Cathy Eastwood: Scientific Manager, Associate Director of Alberta SPOR Methods & Development Platform, Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, AB. She has expertise in clinical data collection, evaluation of local and systemic data quality issues, disease classification coding with ICD-10 and ICD-11. Dr. Hude Quan: Professor, Community Health Sciences, Cumming School of Medicine, University of Calgary, Director Alberta SPOR Methods Platform; Co-Chair of Hypertension Canada, Co-Chair of Person to Population Health Collaborative of the Libin Cardiovascular Institute in Calgary, AB. He has expertise in assessing, validating, and linking administrative data sources for conducting data science research including artificial intelligence methods for evaluating and improving data quality. Intended Outcomes:“What is quality health data?” The panel of experts will address this common question by discussing how to define high quality health data, and measures being taken to ensure that they are available in Canada. Optimizing the quality of clinical-administrative data, and their use-value, first requires an understanding of the processes used to create the data. Subsequently, we can address the limitations in data collection and use these data for diverse applications. Current advances in digital data collection are providing more solutions to improve health data quality at lower cost. This panel will describe a number of quality assessment and improvement initiatives aimed at ensuring that health data are fit for a range of secondary uses including data linkage. It will also discuss how the need for the linkage and integration of data sources can influence the views of the data source’s fitness for use. CIHI content will include: Methods for optimizing the value of clinical-administrative data CIHI Information Quality Framework Reabstraction studies (e.g. physician documentation/coders’ experiences) Linkage analytics for data quality University of Calgary content will include: Defining/measuring health data quality Automated methods for quality assessment and improvement ICD-11 features and coding practices Electronic health record initiatives


Author(s):  
Sara Correia ◽  
Jack Sim

Background with rationaleThe use of administrative data is key to achieving the UK Statistics Authority’s strategy of Better Statistics, Better Decisions. Integrating administrative data into official statistics can benefit policy decisions by allowing the possibility of greater granularity and improved timeliness in outputs, while delivering efficiency gains and reducing respondent burden. Quality assessment and communicating uncertainty of administrative data sources is critical to their effective integration into official statistical outputs. Main AimThis presentation will discuss the main challenges of quality assuring statistical outputs containing administrative data. The differences in existing quality frameworks and identified quality metrics will be discussed. In addition, the presentation will cover the need to tailor quality assessment to answer a specific research question that an identified source is being used for and the considerations required. Methods/ApproachA comprehensive literature review was carried out, bringing together existing quality frameworks and metrics from National Statistical Institutes (NSIs) and academia for production of statistics using administrative data sources. ResultsThe main challenges and considerations faced when quality assuring outputs produced using administrative sources have been identified. The quality requirements for different outputs across social, business and census statistics were summarised and a general quality framework for admin data developed. This framework draws on international best practices for use in the UK statistical system. ConclusionIntegrating administrative data presents challenges can’t be solved by a one-size fits all framework. Through unifying available guidance, an adaptable quality assurance methodology has been created, enabling the use of public data for the public good.


2015 ◽  
Vol 31 (2) ◽  
pp. 231-247 ◽  
Author(s):  
Matthias Schnetzer ◽  
Franz Astleithner ◽  
Predrag Cetkovic ◽  
Stefan Humer ◽  
Manuela Lenk ◽  
...  

Abstract This article contributes a framework for the quality assessment of imputations within a broader structure to evaluate the quality of register-based data. Four quality-related hyperdimensions examine the data processing from the raw-data level to the final statistics. Our focus lies on the quality assessment of different imputation steps and their influence on overall data quality. We suggest classification rates as a measure of accuracy of imputation and derive several computational approaches.


2017 ◽  
Vol 35 (8_suppl) ◽  
pp. 208-208 ◽  
Author(s):  
Melanie Lynn Powis ◽  
Nathan Taback ◽  
Christina Diong ◽  
Katherine Enright ◽  
Christopher M. Booth ◽  
...  

208 Background: There is ongoing interest in leveraging administrative data to examine quality but methodological concerns persist. We evaluated the reliability of a previously established panel of administrative data derived quality measures for systemic cancer treatment. Methods: The study cohort consisted of women diagnosed with early stage (stage I-III) breast cancer (ESBC) in Ontario, Canada, in 2010. Performance on 11 quality indicators evaluated using deterministically linked healthcare administrative databases has been reported previously. The sensitivity and specificity of these 11 indicators were examined using the chart as the gold standard. Results: The administrative cohort consisted of 6,795 women with ESBC from which a validation cohort of 705 patients was randomly selected from among patients who underwent cancer surgery at one of five hospitals chosen to balance feasibility and institutional characteristics.Sensitivity and specificity varied by indicator (Table). Reliability of some indicators may have been affected by suboptimal chart documentation in instances where care spanned multiple settings or the medical record was fragmented, or where the number of eligible patients for that indicator was low. Conclusions: Administrative data can be used to evaluate quality of systemic cancer therapy but understanding the reliability characteristics of individual indicators is essential to inform their appropriate use and interpretation. [Table: see text]


2017 ◽  
Vol 35 (15_suppl) ◽  
pp. e18269-e18269
Author(s):  
Monika K. Krzyzanowska ◽  
Melanie Lynn Powis ◽  
Nathan Taback ◽  
Christina Diong ◽  
Katherine Enright ◽  
...  

e18269 Background: There is ongoing interest in leveraging administrative data to examine quality but methodological concerns persist. We evaluated the reliability of a previously established panel of administrative data derived quality measures for systemic treatment. Methods: The cohort consisted of women diagnosed with early stage (stage I-III) breast cancer (ESBC) in Ontario, Canada, in 2010. Performance on 11 quality indicators evaluated using deterministically linked healthcare administrative databases has been reported previously. Sensitivity and specificity were examined using the chart as the gold standard. Results: The administrative cohort consisted of 6,795 women with ESBC from which a validation cohort of 705 patients was randomly selected from among patients who underwent cancer surgery at one of five hospitals chosen to balance feasibility and institutional characteristics.Sensitivity and specificity varied by indicator (Table 1). Reliability of some indicators may have been affected by suboptimal chart documentation in instances where care spanned multiple settings or the medical record was fragmented, or where the number of eligible patients for that indicator was low. Conclusions: Administrative data can be used to evaluate quality of systemic cancer therapy but understanding the reliability characteristics of individual indicators is essential to inform their appropriate use and interpretation. [Table: see text]


2011 ◽  
Vol 66 (1) ◽  
pp. 18-33 ◽  
Author(s):  
Christopher Berka ◽  
Stefan Humer ◽  
Mathias Moser ◽  
Manuela Lenk ◽  
Henrik Rechta ◽  
...  

Author(s):  
Frauke Kreuter

This article provides a brief overview of key trends in the survey research to address the nonresponse challenge. Noteworthy are efforts to develop new quality measures and to combine several data sources to enhance either the data collection process or the quality of resulting survey estimates. Mixtures of survey data collection modes and less burdensome survey designs are additional steps taken by survey researchers to address nonresponse.


2016 ◽  
Vol 45 (2) ◽  
pp. 3-14 ◽  
Author(s):  
Eva-Maria Asamer ◽  
Franz Astleithner ◽  
Predrag Cetkovic ◽  
Stefan Humer ◽  
Manuela Lenk ◽  
...  

In 2011, Statistics Austria carried out the first register-based census. The use of administrative data for statistical purposes is accompanied by various advantages like a reduced burden for the respondents and less costs for the NSI. However, new challenges, like the quality assessment of this kind of data, arise. Therefore, Statistics Austria developed a comprehensive standardized framework for the evaluation of the data quality for registerbased statistics.In this paper, we present the principle of the quality framework and detailed results from the quality evaluation of the 2011 Austrian census. For each attribute in the census a quality measure is derived from four hyperdimensions. The first three hyperdimensions focus on the documentation of data, the usability of the records and the comparison of data to an external source. The fourth hyperdimension assesses the quality of the imputations. In the framework all the available information on each attribute can be combined to form one final quality indicator. This procedure allows to track changes in quality during data processing and to compare the quality of different census generations.


2020 ◽  
Vol 13 (Suppl_1) ◽  
Author(s):  
Donald E Casey

Despite a 27% reduction in all-cause mortality from targeting a systolic blood pressure of &lt 120 mm Hg, as compared with &lt 140 mm Hg, existing quality measures from the NCQA for controlling HBP (for hypertensive adults 18-59 years of age whose blood pressure was &lt 140/90 mm Hg) have not changed substantially over the past several years for a variety of insured populations, including commercial, Medicaid, Medicare Fee for Service and Medicare Advantage. Re-examining both the targets and processes of managing HBP are thus warranted to help support the use of the latest evidence in optimizing the quality of care and outcomes for patients with HBP. The recently published 2019 ACC/AHA Clinical Performance and Quality Measures for Adults with High Blood Pressure are designed to promote improvements in diagnosis and control of high blood pressure, including a new emphasis on “structural” quality measures that focus on a comprehensive system of care as outlined in the 2017 2017 ACC/AHA guideline for the prevention, detection, evaluation, and management of high blood pressure in adults. The purpose of this presentation will be to provide a detailed overview of this new measure set as a “Blueprint for Change” necessary to overcome current health system inertia and ensure the achievement of better quality of care for people with High Blood Pressure.


2013 ◽  
Vol 04 (01) ◽  
pp. 1-11 ◽  
Author(s):  
A. Shachak ◽  
M. Laberge

SummaryObjective: The objectives of this study are to 1) create a quality assessment tool for socio-demographic data aligned with the needs of Community Health Centres (CHCs) and based on the data quality framework of the Canadian Institute for Health Information (CIHI), and 2) test the feasibility of the tool in CHCs.Methods: The tool was developed based on both theoretical and practical knowledge. A review of the literature was performed to identify data quality frameworks and dimensions that could be employed. In addition, informal discussions with Community Health Centres staff members holding various positions were conducted and a team of subject matter experts was established. This approach supported the alignment between the tool (i.e., the indicators developed, the rating scale, and weighting system) and the setting for which it has been designed. The tool was pilot tested in five CHCs across Ontario.Results: The decision to focus on socio-demographic data was based on findings from the discussions with staff members. The team established nine principles for the development of the tool, including the use of computer software, whenever possible, to query the data and ensure consistency of the measurement. Data quality scores ranged from 45 to 74 on a scale of 0 (lowest quality) to 100 (highest data quality), with one CHC that was not able to run all of the queries. The feedback from staff was positive and supports the feasibility of the tool as an application of the CIHI data quality framework in a local setting.Conclusion: Pilot test results demonstrate the feasibility of the tool and an applicability of the CIHI framework as a basis for developing tools for data quality assessment in health care organizations.Citation: Laberge M, Shachak A. Developing a tool to assess the quality of socio-demographic data in community health centres. Appl Clin Inf 2012; 4:1–11http://dx.doi.org/10.4338/ACI-2012-10-CR-0041


Sign in / Sign up

Export Citation Format

Share Document