Setting analytical performance specifications based on outcome studies – is it possible?

2015 ◽  
Vol 53 (6) ◽  
Author(s):  
Andrea Rita Horvath ◽  
Patrick M.M. Bossuyt ◽  
Sverre Sandberg ◽  
Andrew St John ◽  
Phillip J. Monaghan ◽  
...  
Keyword(s):  
Clinical Outcomes ◽  
Clinical Chemistry ◽  
Health Benefit ◽  
Outcome Data ◽  
Outcome Studies ◽  
Analytical Performance ◽  
Performance Criteria ◽  
European Federation ◽  
Performance Specifications ◽  
The Impact

AbstractThe 1st Strategic Conference of the European Federation of Clinical Chemistry and Laboratory Medicine proposed a simplified hierarchy for setting analytical performance specifications (APS). The top two levels of the 1999 Stockholm hierarchy, i.e., evaluation of the effect of analytical performance on clinical outcomes and clinical decisions have been proposed to be replaced by one outcome-based model. This model can be supported by: (1a) direct outcome studies; and (1b) indirect outcome studies investigating the impact of analytical performance of the test on clinical classifications or decisions and thereby on the probability of patient relevant clinical outcomes.This paper reviews the need for outcome-based specifications, the most relevant types of outcomes to be considered, and the challenges and limitations faced when setting outcome-based APS. The methods of Model 1a and b are discussed and examples are provided for how outcome data can be translated to APS using the linked evidence and simulation or decision analytic techniques.Outcome-based APS should primarily reflect the clinical needs of patients; should be tailored to the purpose, role and significance of the test in a well defined clinical pathway; and should be defined at a level that achieves net health benefit for patients at reasonable costs. Whilst it is acknowledged that direct evaluations are difficult and may not be possible for all measurands, all other forms of setting APS should be weighed against that standard, and regarded as approximations. Better definition of the relationship between the analytical performance of tests and health outcomes can be used to set analytical performance criteria that aim to improve the clinical and cost-effectiveness of laboratory tests.

scholarly journals Analytical Performance Specifications for Lipoprotein(a), Apolipoprotein B-100, and Apolipoprotein A-I Using the Biological Variation Model in the EuBIVAS Population

2020 ◽  
Vol 66 (5) ◽  
pp. 727-736 ◽  
Author(s):  
Noemie Clouet-Foraison ◽  
Santica M Marcovina ◽  
Elena Guerra ◽  
Aasne K Aarsand ◽  
Abdurrahman Coşkun ◽  
...  
Keyword(s):  
Apolipoprotein B ◽  
Clinical Chemistry ◽  
Biological Variation ◽  
Analytical Performance ◽  
European Federation ◽  
Published Data ◽  
Cvd Risk ◽  
Lipoprotein A ◽  
Apolipoprotein A ◽  
Performance Specifications

Abstract Background With increased interest in lipoprotein(a) (Lp[a]) concentration as a target for risk reduction and growing clinical evidence of its impact on cardiovascular disease (CVD) risk, rigorous analytical performance specifications (APS) and accuracy targets for Lp(a) are required. We investigated the biological variation (BV) of Lp(a), and 2 other major biomarkers of CVD, apolipoprotein A-I (apoA-I) and apolipoprotein B-100 (apoB), in the European Biological Variation Study population. Method Serum samples were drawn from 91 healthy individuals for 10 consecutive weeks at 6 European laboratories and analyzed in duplicate on a Roche Cobas 8000 c702. Outlier, homogeneity, and trend analysis were performed, followed by CV-ANOVA to determine BV estimates and their 95% CIs. These estimates were used to calculate APS and reference change values. For Lp(a), BV estimates were determined on normalized concentration quintiles. Results Within-subject BV estimates were significantly different between sexes for Lp(a) and between women aged <50 and >50 years for apoA-I and apoB. Lp(a) APS was constant across concentration quintiles and, overall, lower than APS based on currently published data, whereas results were similar for apoA-I and apoB. Conclusion Using a fully Biological Variation Data Critical Appraisal Checklist (BIVAC)–compliant protocol, our study data confirm BV estimates of Lp(a) listed in the European Federation of Clinical Chemistry and Laboratory Medicine database and reinforce concerns expressed in recent articles regarding the suitability of older APS recommendations for Lp(a) measurements. Given the heterogeneity of Lp(a), more BIVAC-compliant studies on large numbers of individuals of different ethnic groups would be desirable.

scholarly journals The EuBIVAS Project: Within- and Between-Subject Biological Variation Data for Serum Creatinine Using Enzymatic and Alkaline Picrate Methods and Implications for Monitoring

2017 ◽  
Vol 63 (9) ◽  
pp. 1527-1536 ◽  
Author(s):  
Anna Carobene ◽  
Irene Marino ◽  
Abdurrahman Coşkun ◽  
Mustafa Serteser ◽  
Ibrahim Unsal ◽  
...  
Keyword(s):  
Serum Creatinine ◽  
Clinical Chemistry ◽  
Biological Variation ◽  
European Federation ◽  
Healthy Individuals ◽  
Homogeneity Analysis ◽  
Variation Data ◽  
Performance Specifications ◽  
Age Range ◽  
Analytical Variation

Abstract BACKGROUND The European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) European Biological Variation Study (EuBIVAS) has been established to deliver rigorously determined biological variation (BV) indices. EuBIVAS determined BV for serum creatinine using the enzymatic and alkaline picrate measurement methods. METHOD In total, 91 healthy individuals (38 males, 53 females; age range, 21–69 years) were bled for 10 consecutive weeks at 6 European laboratories. An equivalent protocol was followed at each center. Sera were stored at −80 °C before analysis. Analyses for each patient were performed in duplicate within a single run on an ADVIA 2400 system (San Raffaele Hospital, Milan). The data were subjected to outlier and homogeneity analysis before performing CV-ANOVA to determine BV and analytical variation (CVA) estimates with confidence intervals (CI). RESULTS The within-subject BV estimates [CVI (95% CI)] were similar for enzymatic [4.4% (4.2–4.7)] and alkaline picrate [4.7% (4.4–4.9)] methods and lower than the estimate presently available online (CVI = 5.9%). No significant male/female BV differences were found. Significant differences were observed in mean creatinine values between men and women and between Turkish individuals and those of other nationalities. Between-subject BV (CVG) estimates, stratified accordingly, produced CVG values similar to historical BV data. CVA was 1.1% for the enzymatic and 4.4% for alkaline picrate methods, indicating that alkaline picrate methods fail to fulfill analytical performance specifications for imprecision (CVAPS). CONCLUSIONS The serum creatinine CVI obtained by EuBIVAS specifies a more stringent CVAPS than previously identified. The alkaline picrate method failed to meet this CVAPS, raising questions regarding its future use.

Optimizing the use of the “state-of-the-art” performance criteria

2015 ◽  
Vol 53 (6) ◽  
Author(s):  
Rainer Haeckel ◽  
Werner Wosniok ◽  
Thomas Streichert
Keyword(s):  
State Of The Art ◽  
Clinical Chemistry ◽  
Reference Interval ◽  
German Society ◽  
Laboratory Medicine ◽  
Biological Variation ◽  
The State ◽  
Analytical Performance ◽  
Performance Criteria ◽  
Performance Goals

AbstractThe organizers of the first EFLM Strategic Conference “Defining analytical performance goals” identified three models for defining analytical performance goals in laboratory medicine. Whereas the highest level of model 1 (outcome studies) is difficult to implement, the other levels are more or less based on subjective opinions of experts, with models 2 (based on biological variation) and 3 (defined by the state-of-the-art) being more objective. A working group of the German Society of Clinical Chemistry and Laboratory Medicine (DGKL) proposes a combination of models 2 and 3 to overcome some disadvantages inherent to both models. In the new model, the permissible imprecision is not defined as a constant proportion of biological variation but by a non-linear relationship between permissible analytical and biological variation. Furthermore, the permissible imprecision is referred to the target quantity value. The biological variation is derived from the reference interval, if appropriate, after logarithmic transformation of the reference limits.

scholarly journals Strategies to define performance specifications in laboratory medicine: 3 years on from the Milan Strategic Conference

2017 ◽  
Vol 55 (12) ◽  
Author(s):  
Mauro Panteghini ◽  
Ferruccio Ceriotti ◽  
Graham Jones ◽  
Wytze Oosterhuis ◽  
Mario Plebani ◽  
...  
Keyword(s):  
Measurement Errors ◽  
Clinical Chemistry ◽  
Total Error ◽  
Laboratory Medicine ◽  
European Federation ◽  
Quality Of Data ◽  
Performance Specifications ◽  
Fit For Purpose ◽  
Set Up

AbstractMeasurements in clinical laboratories produce results needed in the diagnosis and monitoring of patients. These results are always characterized by some uncertainty. What quality is needed and what measurement errors can be tolerated without jeopardizing patient safety should therefore be defined and specified for each analyte having clinical use. When these specifications are defined, the total examination process will be “fit for purpose” and the laboratory professionals should then set up rules to control the measuring systems to ensure they perform within specifications. The laboratory community has used different models to set performance specifications (PS). Recently, it was felt that there was a need to revisit different models and, at the same time, to emphasize the presuppositions for using the different models. Therefore, in 2014 the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) organized a Strategic Conference in Milan. It was felt that there was a need for more detailed discussions on, for instance, PS for EQAS, which measurands should use which models to set PS and how to set PS for the extra-analytical phases. There was also a need to critically evaluate the quality of data on biological variation studies and further discussing the use of the total error (TE) concept. Consequently, EFLM established five Task Finish Groups (TFGs) to address each of these topics. The TFGs are finishing their activity on 2017 and the content of this paper includes deliverables from these groups.

Analytical performance specifications for external quality assessment – definitions and descriptions

2017 ◽  
Vol 55 (7) ◽  
Author(s):  
Graham R.D. Jones ◽  
Stephanie Albarede ◽  
Dagmar Kesseler ◽  
Finlay MacKenzie ◽  
Joy Mammen ◽  
...  
Keyword(s):  
Quality Assurance ◽  
Analytical Performance ◽  
External Quality Assurance ◽  
European Federation ◽  
Analytical Quality ◽  
External Quality ◽  
Data Set ◽  
Target Value ◽  
Performance Specifications ◽  
Data Points

AbstractExternal Quality Assurance (EQA) is vital to ensure acceptable analytical quality in medical laboratories. A key component of an EQA scheme is an analytical performance specification (APS) for each measurand that a laboratory can use to assess the extent of deviation of the obtained results from the target value. A consensus conference held in Milan in 2014 has proposed three models to set APS and these can be applied to setting APS for EQA. A goal arising from this conference is the harmonisation of EQA APS between different schemes to deliver consistent quality messages to laboratories irrespective of location and the choice of EQA provider. At this time there are wide differences in the APS used in different EQA schemes for the same measurands. Contributing factors to this variation are that the APS in different schemes are established using different criteria, applied to different types of data (e.g. single data points, multiple data points), used for different goals (e.g. improvement of analytical quality; licensing), and with the aim of eliciting different responses from participants. This paper provides recommendations from the European Federation of Laboratory Medicine (EFLM) Task and Finish Group on Performance Specifications for External Quality Assurance Schemes (TFG-APSEQA) and on clear terminology for EQA APS. The recommended terminology covers six elements required to understand APS: 1) a statement on the EQA material matrix and its commutability; 2) the method used to assign the target value; 3) the data set to which APS are applied; 4) the applicable analytical property being assessed (i.e. total error, bias, imprecision, uncertainty); 5) the rationale for the selection of the APS; and 6) the type of the Milan model(s) used to set the APS. The terminology is required for EQA participants and other interested parties to understand the meaning of meeting or not meeting APS.

scholarly journals Balloon guide catheter improvements in thrombectomy outcomespersist despite advances in intracranial aspiration technology

2021 ◽  
pp. neurintsurg-2020-017027
Author(s):  
Jordi Blasco ◽  
Josep Puig ◽  
Pepus Daunis-i-Estadella ◽  
Eva González ◽  
Juan Jose Fondevila Monso ◽  
...  
Keyword(s):  
Clinical Outcome ◽  
Clinical Outcomes ◽  
Outcome Data ◽  
Anterior Circulation ◽  
Vessel Occlusion ◽  
Guide Catheter ◽  
Improved Outcomes ◽  
Procedural Time ◽  
The Impact ◽  
Contemporary Technology

BackgroundFirst-pass effect (FPE) has been established as a key metric for technical success and strongly correlates with better clinical outcomes. Most data supporting improved outcomes with the use of a balloon guide catheter (BGC) predate the advent of last-generation large-bore intracranial aspiration catheters. We aim to evaluate the impact of BGC in FPE and clinical outcomes in a large cohort of patients treated with contemporary technology.MethodsPatients were recruited from the prospectively ongoing ROSSETTI registry. This registry includes all consecutive patients with anterior circulation large-vessel occlusion (LVO) from 10 comprehensive stroke centers in Spain. Demographic, clinical, angiographic, and clinical outcome data were compared between BGC and non-BGC groups. FPE was defined as the achievement of mTICI2c–3 after a single device pass.Results426 patients were included out of which 271 (63.62%) used BCG. BGC-treated patients had higher FPE rate (45.8% vs 27.7%; P<0.001), higher final mTICI ≥2 c recanalization rate (76.8% vs 50.3%, respectively; P<0.001), shorter procedural time [median (IQR), 30 (19–58) vs 43 (33–71) min; P<0.001], higher NIHSS difference from admission to 24 hours [median (IQR), 8 (2–12) vs 3 (0–10); P=0.001], and lower mortality rate (17.6% vs 29.8%, P=0.026) compared with non-BGC patients. BGC use was an independent predictor of FPE (OR 2.197, 95% CI 1.436 to 3.361; P<0.001), and excellent clinical outcome at 3 months (OR 0.34, 95% CI 0.17 to 0.68; P=0.002).ConclusionsOur results support the benefit of BGC use on angiographic and clinical outcomes in anterior circulation LVO ischemic stroke remain significant even when considering recent improvements in intracranial aspiration technology.

Sign in / Sign up

Export Citation Format

Share Document