Defining analytical performance specifications: Consensus Statement from the 1st Strategic Conference of the European Federation of Clinical Chemistry and Laboratory Medicine

Author(s):  
Sverre Sandberg ◽  
Callum G. Fraser ◽  
Andrea Rita Horvath ◽  
Rob Jansen ◽  
Graham Jones ◽  
...  
Author(s):  
Mauro Panteghini ◽  
Ferruccio Ceriotti ◽  
Graham Jones ◽  
Wytze Oosterhuis ◽  
Mario Plebani ◽  
...  

AbstractMeasurements in clinical laboratories produce results needed in the diagnosis and monitoring of patients. These results are always characterized by some uncertainty. What quality is needed and what measurement errors can be tolerated without jeopardizing patient safety should therefore be defined and specified for each analyte having clinical use. When these specifications are defined, the total examination process will be “fit for purpose” and the laboratory professionals should then set up rules to control the measuring systems to ensure they perform within specifications. The laboratory community has used different models to set performance specifications (PS). Recently, it was felt that there was a need to revisit different models and, at the same time, to emphasize the presuppositions for using the different models. Therefore, in 2014 the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) organized a Strategic Conference in Milan. It was felt that there was a need for more detailed discussions on, for instance, PS for EQAS, which measurands should use which models to set PS and how to set PS for the extra-analytical phases. There was also a need to critically evaluate the quality of data on biological variation studies and further discussing the use of the total error (TE) concept. Consequently, EFLM established five Task Finish Groups (TFGs) to address each of these topics. The TFGs are finishing their activity on 2017 and the content of this paper includes deliverables from these groups.


Author(s):  
Andrea Rita Horvath ◽  
Patrick M.M. Bossuyt ◽  
Sverre Sandberg ◽  
Andrew St John ◽  
Phillip J. Monaghan ◽  
...  

AbstractThe 1st Strategic Conference of the European Federation of Clinical Chemistry and Laboratory Medicine proposed a simplified hierarchy for setting analytical performance specifications (APS). The top two levels of the 1999 Stockholm hierarchy, i.e., evaluation of the effect of analytical performance on clinical outcomes and clinical decisions have been proposed to be replaced by one outcome-based model. This model can be supported by: (1a) direct outcome studies; and (1b) indirect outcome studies investigating the impact of analytical performance of the test on clinical classifications or decisions and thereby on the probability of patient relevant clinical outcomes.This paper reviews the need for outcome-based specifications, the most relevant types of outcomes to be considered, and the challenges and limitations faced when setting outcome-based APS. The methods of Model 1a and b are discussed and examples are provided for how outcome data can be translated to APS using the linked evidence and simulation or decision analytic techniques.Outcome-based APS should primarily reflect the clinical needs of patients; should be tailored to the purpose, role and significance of the test in a well defined clinical pathway; and should be defined at a level that achieves net health benefit for patients at reasonable costs. Whilst it is acknowledged that direct evaluations are difficult and may not be possible for all measurands, all other forms of setting APS should be weighed against that standard, and regarded as approximations. Better definition of the relationship between the analytical performance of tests and health outcomes can be used to set analytical performance criteria that aim to improve the clinical and cost-effectiveness of laboratory tests.


2020 ◽  
Vol 66 (5) ◽  
pp. 727-736 ◽  
Author(s):  
Noemie Clouet-Foraison ◽  
Santica M Marcovina ◽  
Elena Guerra ◽  
Aasne K Aarsand ◽  
Abdurrahman Coşkun ◽  
...  

Abstract Background With increased interest in lipoprotein(a) (Lp[a]) concentration as a target for risk reduction and growing clinical evidence of its impact on cardiovascular disease (CVD) risk, rigorous analytical performance specifications (APS) and accuracy targets for Lp(a) are required. We investigated the biological variation (BV) of Lp(a), and 2 other major biomarkers of CVD, apolipoprotein A-I (apoA-I) and apolipoprotein B-100 (apoB), in the European Biological Variation Study population. Method Serum samples were drawn from 91 healthy individuals for 10 consecutive weeks at 6 European laboratories and analyzed in duplicate on a Roche Cobas 8000 c702. Outlier, homogeneity, and trend analysis were performed, followed by CV-ANOVA to determine BV estimates and their 95% CIs. These estimates were used to calculate APS and reference change values. For Lp(a), BV estimates were determined on normalized concentration quintiles. Results Within-subject BV estimates were significantly different between sexes for Lp(a) and between women aged <50 and >50 years for apoA-I and apoB. Lp(a) APS was constant across concentration quintiles and, overall, lower than APS based on currently published data, whereas results were similar for apoA-I and apoB. Conclusion Using a fully Biological Variation Data Critical Appraisal Checklist (BIVAC)–compliant protocol, our study data confirm BV estimates of Lp(a) listed in the European Federation of Clinical Chemistry and Laboratory Medicine database and reinforce concerns expressed in recent articles regarding the suitability of older APS recommendations for Lp(a) measurements. Given the heterogeneity of Lp(a), more BIVAC-compliant studies on large numbers of individuals of different ethnic groups would be desirable.


Author(s):  
Marc H.M. Thelen ◽  
Rob T.P. Jansen ◽  
Cas W. Weykamp ◽  
Herman Steigstra ◽  
Ron Meijer ◽  
...  

AbstractBackground:To provide its participants with an external quality assessment system (EQAS) that can be used to check trueness, the Dutch EQAS organizer, Organization for Quality Assessment of Laboratory Diagnostics (SKML), has innovated its general chemistry scheme over the last decade by introducing fresh frozen commutable samples whose values were assigned by Joint Committee for Traceability in Laboratory Medicine (JCTLM)-listed reference laboratories using reference methods where possible. Here we present some important innovations in our feedback reports that allow participants to judge whether their trueness and imprecision meet predefined analytical performance specifications.Methods:Sigma metrics are used to calculate performance indicators named ‘sigma values’. Tolerance intervals are based on both Total Error allowable (TEa) according to biological variation data and state of the art (SA) in line with the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) Milan consensus.Results:The existing SKML feedback reports that express trueness as the agreement between the regression line through the results of the last 12 months and the values obtained from reference laboratories and calculate imprecision from the residuals of the regression line are now enriched with sigma values calculated from the degree to which the combination of trueness and imprecision are within tolerance limits. The information and its conclusion to a simple two-point scoring system are also graphically represented in addition to the existing difference plot.Conclusions:By adding sigma metrics-based performance evaluation in relation to both TEa and SA tolerance intervals to its EQAS schemes, SKML provides its participants with a powerful and actionable check on accuracy.


Author(s):  
Marc H.M. Thelen ◽  
Florent J.L.A. Vanstapel ◽  
Christos Kroupis ◽  
Ines Vukasovic ◽  
Guilaime Boursier ◽  
...  

AbstractThe recent revision of ISO15189 has further strengthened its position as the standard for accreditation for medical laboratories. Both for laboratories and their customers it is important that the scope of such accreditation is clear. Therefore the European co-operation for accreditation (EA) demands that the national bodies responsible for accreditation describe the scope of every laboratory accreditation in a way that leaves no room for doubt about the range of competence of the particular laboratories. According to EA recommendations scopes may be fixed, mentioning every single test that is part of the accreditation, or flexible, mentioning all combinations of medical field, examination type and materials for which the laboratory is competent. Up to now national accreditation bodies perpetuate use of fixed scopes, partly by inertia, partly out of fear that a too flexible scope may lead to over-valuation of the competence of laboratories, most countries only use fixed scopes. The EA however promotes use of flexible scopes, since this allows for more readily innovation, which contributes to quality in laboratory medicine. In this position paper, the Working Group Accreditation and ISO/CEN Standards belonging to the Quality and Regulation Committee of the EFLM recommends using an approach that has led to successful introduction of the flexible scope for ISO15189 accreditation as intended in EA-4/17 in The Netherlands. The approach is risk-based, discipline and competence-based, and focuses on defining a uniform terminology transferable across the borders of scientific disciplines, laboratories and countries.


2018 ◽  
Vol 56 (10) ◽  
pp. 1591-1597 ◽  
Author(s):  
Eric S. Kilpatrick ◽  
Sverre Sandberg

Abstract The European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) has initiated many harmonization activities in all phases of the examination process. The EFLM is dealing with both the scientific and the educational aspects of harmonization, with the intention of disseminating best practice in laboratory medicine throughout Europe. Priorities have been given (1) to establish a standard for conducting and assessing biological variation studies and to construct an evidence based EFLM webpage on biological variation data, (2) to harmonize preanalytical procedures by producing European guidelines, (3) to improve test ordering and interpretation, (4) to produce other common European guidelines for laboratory medicine and play an active part in development of clinical guidelines, (5) to establish a common basis for communicating laboratory results to patients, (6) to harmonize units of measurement throughout Europe, (7) to harmonize preanalytical procedures in molecular diagnostics and (8) to harmonize and optimize test evaluation procedures. The EFLM is also now launching the 5th version of the European Syllabus to help the education of European Specialists in Laboratory Medicine (EuSpLM), which is being supported by the development of e-learning courses. A register of EuSpLM is already established for members of National Societies in EU countries, and a similar register will be established for specialists in non-EU countries.


Sign in / Sign up

Export Citation Format

Share Document