Assessment of medical devices: How to conduct comparative technology evaluations of product performance

2007 ◽  
Vol 23 (4) ◽  
pp. 455-463 ◽  
Author(s):  
Lawton R. Burns ◽  
Eric T. Bradlow ◽  
J. Andrew Lee ◽  
Anthony C. Antonacci

Objectives: U.S. expenditures on medical devices ($70 billion in 2003) are one of the fastest growing components of hospital costs. Physicians’ selection of medical devices lacks an evidence base on the comparative clinical effectiveness of these products. Comparative studies (e.g., vendor 1 versus vendor 2, technology A versus technology B) are increasingly promoted in the public sector as a means of cost containment, value-based purchasing, and quality improvement. This study illustrates how hospitals and physicians can conduct comparative technology assessments of product performance.Methods: Surgeons evaluated comparable medical devices manufactured by eight different vendors in standardized surgical procedures. Devices included sutures and endomechanical products, which account for $2.5 billion of total device spending. Evaluations covered multiple performance dimensions, including ergonomics, functionality, clinical acceptability, and vendor preference.Results: One vendor's products garnered consistently high ratings from surgeons, while two other vendors garnered consistently low ratings. Differences in ratings were statistically significant and persist when controlling for physician background characteristics and prior experience. Study results were used by a large hospital group purchasing organization to select which vendors to contract with for these products.Conclusions: Comparative technology evaluations assist physicians and hospitals in making cost-effective purchases of devices. These evaluations provide robust information on the performance of products routinely used by clinicians. Such evaluations can be carefully designed to have scientific rigor and clinical credibility.

2017 ◽  
Vol 5 (3) ◽  
pp. 1-316 ◽  
Author(s):  
Hugh MacPherson ◽  
Andrew Vickers ◽  
Martin Bland ◽  
David Torgerson ◽  
Mark Corbett ◽  
...  

BackgroundThere has been an increase in the utilisation of acupuncture in recent years, yet the evidence base is insufficiently well established to be certain about its clinical effectiveness and cost-effectiveness. Addressing the questions related to the evidence base will reduce uncertainty and help policy- and decision-makers with regard to whether or not wider access is appropriate and provides value for money.AimOur aim was to establish the most reliable evidence on the clinical effectiveness and cost-effectiveness of acupuncture for chronic pain by drawing on relevant evidence, including recent high-quality trials, and to develop fresh evidence on acupuncture for depression. To extend the evidence base we synthesised the results of published trials using robust systematic review methodology and conducted a randomised controlled trial (RCT) of acupuncture for depression.Methods and resultsWe synthesised the evidence from high-quality trials of acupuncture for chronic pain, consisting of musculoskeletal pain related to the neck and low back, osteoarthritis of the knee, and headache and migraine, involving nearly 18,000 patients. In an individual patient data (IPD) pairwise meta-analysis, acupuncture was significantly better than both sham acupuncture (p < 0.001) and usual care (p < 0.001) for all conditions. Using network meta-analyses, we compared acupuncture with other physical therapies for osteoarthritis of the knee. In both an analysis of all available evidence and an analysis of a subset of better-quality trials, using aggregate-level data, we found acupuncture to be one of the more effective therapies. We developed new Bayesian methods for analysing multiple individual patient-level data sets to evaluate heterogeneous continuous outcomes. An accompanying cost-effectiveness analysis found transcutaneous electrical nerve stimulation (TENS) to be cost-effective for osteoarthritis at a threshold of £20,000 per quality-adjusted life-year when all trials were synthesised. When the analysis was restricted to trials of higher quality with adequate allocation concealment, acupuncture was cost-effective. In a RCT of acupuncture or counselling compared with usual care for depression, in which half the patients were also experiencing comorbid pain, we found acupuncture and counselling to be clinically effective and acupuncture to be cost-effective. For patients in whom acupuncture is inappropriate or unavailable, counselling is cost-effective.ConclusionWe have provided the most robust evidence from high-quality trials on acupuncture for chronic pain. The synthesis of high-quality IPD found that acupuncture was more effective than both usual care and sham acupuncture. Acupuncture is one of the more clinically effective physical therapies for osteoarthritis and is also cost-effective if only high-quality trials are analysed. When all trials are analysed, TENS is cost-effective. Promising clinical and economic evidence on acupuncture for depression needs to be extended to other contexts and settings. For the conditions we have investigated, the drawing together of evidence on acupuncture from this programme of research has substantially reduced levels of uncertainty. We have identified directions for further research. Our research also provides a valuable basis for considering the potential role of acupuncture as a referral option in health care and enabling providers and policy-makers to make decisions based on robust sources of evidence.Trial registrationCurrent Controlled Trials ISRCTN63787732.FundingThe National Institute for Health Research Programme Grants for Applied Research programme.


2016 ◽  
Vol 20 (24) ◽  
pp. 1-486 ◽  
Author(s):  
Elizabeth Thurgar ◽  
Samantha Barton ◽  
Charlotta Karner ◽  
Steven J Edwards

BackgroundTypically occurring on the external genitalia, anogenital warts (AGWs) are benign epithelial skin lesions caused by human papillomavirus infection. AGWs are usually painless but can be unsightly and physically uncomfortable, and affected people might experience psychological distress. The evidence base on the clinical effectiveness and cost-effectiveness of treatments for AGWs is limited.ObjectivesTo systematically review the evidence on the clinical effectiveness of medical and surgical treatments for AGWs and to develop an economic model to estimate the cost-effectiveness of the treatments.Data sourcesElectronic databases (MEDLINE, MEDLINE In-Process & Other Non-Indexed Citations, EMBASE, The Cochrane Library databases and Web of Science) were searched from inception (or January 2000 for Web of Science) to September 2014. Bibliographies of relevant systematic reviews were hand-searched to identify potentially relevant studies. The World Health Organization International Clinical Trials Registry Platform and ClinicalTrials.gov were searched for ongoing and planned studies.Review methodsA systematic review of the clinical effectiveness literature was carried out according to standard methods and a mixed-treatment comparison (MTC) undertaken. The model implemented for each outcome was that with the lowest deviance information criterion. A de novo economic model was developed to assess cost-effectiveness from the perspective of the UK NHS. The model structure was informed through a systematic review of the economic literature and in consultation with clinical experts. Effectiveness data were obtained from the MTC. Costs were obtained from the literature and standard UK sources.ResultsOf 4232 titles and abstracts screened for inclusion in the review of clinical effectiveness, 60 randomised controlled trials (RCTs) evaluating 19 interventions were included. Analysis by MTC indicated that ablative techniques were typically more effective than topical interventions at completely clearing AGWs at the end of treatment. Podophyllotoxin 0.5% solution (Condyline®, Takeda Pharmaceutical Company Ltd; Warticon®solution, Stiefel Laboratories Ltd) was found to be the most effective topical treatment evaluated. Networks for other outcomes included fewer treatments, which restrict conclusions on the comparative effectiveness of interventions. In total, 84 treatment strategies were assessed using the economic model. Podophyllotoxin 0.5% solution first line followed by carbon dioxide (CO2) laser therapy second line if AGWs did not clear was most likely to be considered a cost-effective use of resources at a willingness to pay of £20,000–30,000 per additional quality-adjusted life-year gained. The result was robust to most sensitivity analyses conducted.LimitationsLimited reporting in identified studies of baseline characteristics for the enrolled population generates uncertainty around the comparability of the study populations and therefore the generalisability of the results to clinical practice. Subgroup analyses were planned based on type, number and size of AGWs, all of which are factors thought to influence treatment effect. Lack of data on clinical effectiveness based on these characteristics precluded analysis of the differential effects of treatments in the subgroups of interest. Despite identification of 60 studies, most comparisons in the MTC are informed by only one RCT. Additionally, lack of head-to-head RCTs comparing key treatments, together with minimal reporting of results in some studies, precluded comprehensive analysis of all treatments for AGWs.ConclusionsThe results generated by the MTC are in agreement with consensus opinion that ablative techniques are clinically more effective at completely clearing AGWs after treatment. However, the evidence base informing the MTC is limited. A head-to-head RCT that evaluates the comparative effectiveness of interventions used in clinical practice would help to discern the potential advantages and disadvantages of the individual treatments. The results of the economic analysis suggest that podophyllotoxin 0.5% solution is likely to represent a cost-effective first-line treatment option. More expensive effective treatments, such as CO2laser therapy or surgery, may represent cost-effective second-line treatment options. No treatment and podophyllin are unlikely to be considered cost-effective treatment options. There is uncertainty around the cost-effectiveness of treatment with imiquimod, trichloroacetic acid and cryotherapy.Study registrationThis study is registered as PROSPERO CRD42013005457.FundingThe National Institute for Health Research Health Technology Assessment programme.


Water ◽  
2019 ◽  
Vol 11 (4) ◽  
pp. 758 ◽  
Author(s):  
Jia ◽  
Sitzenfrei ◽  
Rauch ◽  
Liang ◽  
Liu

The development of urban drainage systems is challenged by rapid urbanization; however, little attention is paid to the urban form and its effects on these systems. This study develops an integrated city-drainage model that configures typical urban forms and their associated drainage infrastructures, specifically domestic wastewater and rainwater systems, to analyze the relationship between them. Three typical types of urban forms were investigated: the square, the star, and the strip. Virtual cities were designed first, with the corresponding drainage systems generated automatically and then linked to a model herein called the Storm Water Management Model (SWMM). Evaluation was based on 200 random configurations of wastewater/rainwater systems with different structures or attributes. The results show that urban forms play more important roles on three dimensions of performance, namely economic efficiency, effectiveness, and adaptability, of the rainwater systems than of the wastewater systems. Cost is positively correlated to the effectiveness of rainwater systems among the different urban forms, while adaptability is negatively correlated to the other two performance dimensions. Regardless of the form, it is difficult for a city to make its drainage systems simultaneously cost-effective, efficient, and adaptable based on the virtual cities we investigated. This study could inspire the urban planning of both built-up and to-be-built areas to become more sustainable with their drainage infrastructure by recognizing the pros and cons of different macroscale urban forms.


Geriatrics ◽  
2021 ◽  
Vol 6 (1) ◽  
pp. 26
Author(s):  
Christopher Fang ◽  
Andrew Hagar ◽  
Matthew Gordon ◽  
Carl T. Talmo ◽  
David A. Mattingly ◽  
...  

The proportion of patients over the age of 90 years continues to grow, and the anticipated demand for total joint arthroplasty (TJA) in this population is expected to rise concomitantly. As the country shifts to alternative reimbursement models, data regarding hospital expenses is needed for accurate risk-adjusted stratification. The aim of this study was to compare total in-hospital costs following primary TJA in octogenarians and nonagenarians, and to determine the primary drivers of cost. This was a retrospective analysis from a single institution in the U.S. We used time-drive activity-based costing (TDABC) to capture granular total hospital costs for each patient. 889 TJA’s were included in the study, with 841 octogenarians and 48 nonagenarians. Nonagenarians were more likely to undergo total hip arthroplasty (THA) (70.8% vs. 42.4%; p < 0.0001), had higher ASA classification (2.6 vs. 2.4; p = 0.049), and were more often privately insured (35.4% vs. 27.8%; p = 0.0001) as compared to octogenarians. Nonagenarians were more often discharged to skilled nursing facilities (56.2% vs. 37.5%; p = 0.0011), experienced longer operating room (OR) time (142 vs. 133; p = 0.0201) and length of stay (3.7 vs. 3.1; p = 0.0003), and had higher implant and total in-hospital costs (p < 0.0001 and 0.0001). Multivariate linear regression showed implant cost (0.700; p < 0.0001), length of stay (0.546; p < 0.0001), and OR time (0.288; p < 0.0001) to be the strongest associations with overall costs. Primary TJA for nonagenarians was more expensive than octogenarians. Targeting implant costs, length of stay, and OR time can reduce costs for nonagenarians in order to provide cost-effective value-based care.


Breathe ◽  
2016 ◽  
Vol 12 (2) ◽  
pp. 113-119 ◽  
Author(s):  
Phyllis Murphie ◽  
Nick Hex ◽  
Jo Setters ◽  
Stuart Little

“Non-delivery” home oxygen technologies that allow self-filling of ambulatory oxygen cylinders are emerging. They can offer a relatively unlimited supply of ambulatory oxygen in suitably assessed people who require long-term oxygen therapy (LTOT), providing they can use these systems safely and effectively. This allows users to be self-sufficient and facilitates longer periods of time away from home. The evolution and evidence base of this technology is reported with the experience of a national service review in Scotland (UK). Given that domiciliary oxygen services represent a significant cost to healthcare providers globally, these systems offer potential cost savings, are appealing to remote and rural regions due to the avoidance of cylinder delivery and have additional lower environmental impact due to reduced fossil fuel consumption and subsequently reduced carbon emissions. Evidence is emerging that self-fill/non-delivery oxygen systems can meet the ambulatory oxygen needs of many patients using LTOT and can have a positive impact on quality of life, increase time spent away from home and offer significant financial savings to healthcare providers.Educational aimsProvide update for oxygen prescribers on options for home oxygen provision.Provide update on the evidence base for available self-fill oxygen technologies.Provide and update for healthcare commissioners on the potential cost-effective and environmental benefits of increased utilisation of self-fill oxygen systems.


2012 ◽  
Vol 15 (2) ◽  
pp. 607-619 ◽  
Author(s):  
A. L. Yang ◽  
G. H. Huang ◽  
X. S. Qin ◽  
L. Li ◽  
W. Li

A simulation-based fuzzy optimization method (SFOM) was proposed for regional groundwater pumping management in considering uncertainties. SFOM enhanced the traditional groundwater management models by incorporating a response matrix model (RMM) into a fuzzy chance-constrained programming (FCCP) framework. RMM was used to approximate the input–output relationship between pumping actions and subsurface hydrologic responses. Due to its explicit expression, RMM could be easily embedded into an optimization model to help seek cost-effective pumping solutions. A groundwater management case in Pinggu District of Beijing, China, was used to demonstrate the method's applicability. The study results showed that the obtained system cost and pumping rates would vary significantly under different confidence levels of constraints satisfaction. The decision-makers could identify the best groundwater pumping strategy through analyzing the tradeoff between the risk of violating the related water resources conservation target and the economic benefit. Compared with traditional approaches, SFOM was particularly advantageous in linking simulation and optimization models together, and tackling uncertainties using fuzzy chance constraints.


2003 ◽  
Vol 27 (6) ◽  
pp. 214-216 ◽  
Author(s):  
Mervyn London ◽  
Juan Canitrot ◽  
Adrian Dzialdowski ◽  
Robert Bates ◽  
Alan Gwynn

Aims and MethodTo identify the proportion of arrested drug misusers with prior contact with treatment services, police surgeons' records were examined over a 12-month period and compared with the records of the local drug misuse services. Both referrals and those who attended with face-to-face contact were noted.ResultsSixty-seven per cent of drug-related cases had been referred to services prior to arrest and 58% had attended with face-to-face contact on at least one occasion. Homeless and male drug users were more likely to have had no past contact. Police surgeons treated three-quarters of the cases for opiate dependence. Drug misusers were much more likely to have had past contact with services than arrested alcohol misusers, and were more likely to reoffend.Clinical ImplicationsThe evidence base for motivational enhancement in the transient coercive setting of police custody is not established, and arrest referral schemes might not be cost-effective in areas where most cases have had previous contact with services. Local research may contribute to more informed decisions about these treatment-related criminal justice initiatives.


BMJ Open ◽  
2019 ◽  
Vol 9 (9) ◽  
pp. e030678 ◽  
Author(s):  
Julija Simpson ◽  
Mehdi Javanbakht ◽  
Luke Vale

BackgroundNon-ST-elevation myocardial infarction (NSTEMI) is the most common type of heart attack in the UK and it is becoming increasingly prevalent among older people. An early invasive treatment strategy may be effective and cost-effective for treating NSTEMI but evidence is currently unclear.ObjectivesTo assess the cost-effectiveness of the early invasive strategy versus medical management in elderly patients with NSTEMI and to provide guidance for future research in this area.MethodsA long-term Markov state transition model was developed. Model inputs were systematically derived from a number of sources most appropriate to a UK relevant analysis, such as published studies and national routine data. Costs were estimated from the perspective of National Health Service and Personal Social Services. The model was developed using TreeAge Pro software. Based on a probabilistic sensitivity analysis, a value of information analysis was carried out to establish the value of decision uncertainty both overall and for specific input parameters.ResultsIn 2017 UK £, the incremental cost-effectiveness ratio of the early invasive strategy was £46 916 for each additional quality-adjusted life-year (QALY) gained, with a probability of being cost-effective of 23% at a cost-effectiveness threshold of £20 000/QALY. There was a considerable decision uncertainty with these results. The value of removing all this uncertainty was up to £1 920 000 annually. Most uncertainty related to clinical effectiveness parameters and the optimal study design to remove this uncertainty would be a randomised controlled trial.ConclusionBased on current evidence, the early invasive strategy is not likely to be cost-effective for elderly patients with NSTEMI. This conclusion should be interpreted with caution mainly due to the absence of NSTEMI-specific data and long-term clinical effectiveness estimates.


Sign in / Sign up

Export Citation Format

Share Document