scholarly journals Should We Trust our Judgments about the Proficiency of Motivational Interviewing Counselors?A Glimpse at the Impact of Low Inter-rater Reliability

Author(s):  
Chris Dunn ◽  
Doyanne Darnell ◽  
Sheng Kung Michael Yi ◽  
Mark Steyvers ◽  
Kristin Bumgardner ◽  
...  

Standardized rating systems are often used to evaluate the proficiency of Motivational Interviewing (MI) counselors. The published inter-rater reliability (degree of coder agreement)  in many studies using these instruments has varied a great deal; some studies report MI proficiency scores that have only fair inter-rater reliability, and others report scores with excellent reliability. How much can we to trust the scores with fair versus excellent reliability? Using a Monte Carlo statistical simulation, we compared the impact of fair (0.50) versus excellent (0.90) reliability on the error rates of falsely judging a given counselor as MI proficient or not proficient. We found that improving the inter-rater reliability of any given score from 0.5 to 0.9 would cause a marked reduction in proficiency judgment errors, a reduction that in some MI evaluation situations would be critical. We discuss some practical tradeoffs inherent in various MI evaluation situations, and offer suggestions for applying findings from formal MI research to problems faced by real-world MI evaluators, to help them minimize the MI proficiency judgment errors bearing the greatest cost.


Author(s):  
Shreshta Rajakumar Deshpande ◽  
Shobhit Gupta ◽  
Dennis Kibalama ◽  
Nicola Pivaro ◽  
Marcello Canova

Abstract Connectivity and automation have accelerated the development of algorithms that use route and real-time traffic information for improving energy efficiency. The evaluation of such benefits, however, requires establishing a reliable baseline that is representative of a real-world driving environment. In this context, virtual driver models are generally adopted to predict the vehicle speed based on route data and presence of lead vehicles, in a way that mimics the response of human drivers. This paper proposes an Enhanced Driver Model (EDM) that forecasts the human response when driving in urban conditions, considering the effects of Signal Phasing and Timing (SPaT) by introducing the concept of Line-of-Sight (LoS). The model was validated against data collected on an instrumented vehicle driven on public roads by different human subjects. Using this model, a Monte Carlo simulation is conducted to determine the statistical distribution of fuel consumption and travel time on a given route, varying driver behavior (aggressiveness), traffic conditions and SPaT. This allows one to quantify the impact of uncertainties associated to real-world driving in fuel economy estimates.



2018 ◽  
Vol 3 (5) ◽  
pp. 545-550 ◽  
Author(s):  
Daniel P. Langley ◽  
Mélanie Lagrange ◽  
Ngoc Duy Nguyen ◽  
Daniel Bellet

This work directly compares the percolation threshold of silver nanowire networks to predictions from Monte Carlo simulations, focusing particularly on incorporating the impact of real world imperfections. This SEM image of silver nanowire networks compared to MATLAB simulation based on the physical characteristics of the sample.



Diabetes ◽  
2020 ◽  
Vol 69 (Supplement 1) ◽  
pp. 1607-P
Author(s):  
MAYU HAYASHI ◽  
KATSUTARO MORINO ◽  
KAYO HARADA ◽  
MIKI ISHIKAWA ◽  
ITSUKO MIYAZAWA ◽  
...  


2020 ◽  
Author(s):  
Matthew Wade ◽  
Nicola Brown ◽  
James Steele ◽  
Steven Mann ◽  
Bernadette Dancy ◽  
...  

Background: Brief advice is recommended to increase physical activity (PA) within primary care. This study assessed change in PA levels and mental wellbeing after a motivational interviewing (MI) community-based PA intervention and the impact of signposting [SP] and Social Action [SA] (i.e. weekly group support) pathways. Methods: Participants (n=2084) took part in a community-based, primary care PA programme using MI techniques. Self-reported PA and mental wellbeing data were collected at baseline (following an initial 30-minute MI appointment), 12-weeks, six-months, and 12-months. Participants were assigned based upon the surgery they attended to the SP or SA pathway. Multilevel models were used to derive point estimates and 95%CIs for outcomes at each time point and change scores. Results: Participants increased PA and mental wellbeing at each follow-up time point through both participant pathways and with little difference between pathways. Retention was similar between pathways at 12-weeks, but the SP pathway retained more participants at six-months and 12-months. Conclusions: Both pathways produced similar improvements in PA and mental wellbeing, suggesting the effectiveness of MI based PA interventions. However, due to lower resources required yet similar effects, SP pathways are recommended over SA to support PA in primary care settings.



2021 ◽  
Vol 80 (Suppl 1) ◽  
pp. 839.2-840
Author(s):  
C. Vesel ◽  
A. Morton ◽  
M. Francis-Sedlak ◽  
B. Lamoreaux

Background:NHANES data indicate that approximately 9.2 million Americans have gout,1 with a small subset having uncontrolled disease.2 Pegloticase is a PEGylated recombinant uricase enzyme indicated for treating uncontrolled gout that markedly reduces serum uric acid levels (sUA)3 and resolves tophi in treatment responders.4 Despite pegloticase availability in the US for many years, real world demographics of pegloticase users in the treatment of uncontrolled gout have not been previously reported in a population-based cohort.Objectives:This study utilized a large US claims database to examine demographics and co-morbidities of uncontrolled gout patients treated with pegloticase. Kidney function before and after pegloticase treatment and concomitant therapy with immunomodulators were also examined.Methods:The TriNetX Diamond database includes de-identified data from 4.3 million US patients with gout (as of September 2019), including demographics, medical diagnoses, laboratory values, procedures (e.g. infusions, surgeries), and pharmacy data. Patients who had received ≥1 pegloticase infusion were included in these analyses. The number of infusions was evaluated for a subgroup of patients who were in the database ≥3 months before and ≥2 years after the first pegloticase infusion (i.e. first infusion prior to September 2017) to ensure only complete courses of therapy were captured. In this subpopulation, kidney function before and after pegloticase therapy was examined, along with the presence of immunomodulation prescriptions (methotrexate, mycophenolate mofetil, azathioprine, leflunomide) within 60 days prior to and 14 days after the first pegloticase infusion.Results:1494 patients treated with pegloticase were identified. Patients were 63.1 ± 14.0 years of age (range: 23–91), mostly male (82%), and white (76%). Mean sUA prior to pegloticase was 8.7 ± 2.4 mg/dL (n=50), indicating uncontrolled gout in the identified population. The most commonly reported comorbidities were chronic kidney disease (CKD, 48%), essential hypertension (71%), type 2 diabetes (39%), and cardiovascular disease (38%), similar to pegloticase pivotal Phase 3 trial populations. In patients with pre-therapy kidney function measures (n=134), pre-treatment eGFR averaged 61.2 ± 25.7 ml/min/1.73 m2, with 44% having Stage 3-5 CKD. In patients with complete therapy course capture and pre- and post-therapy eGFR measures (n=48), kidney function remained stable (change in eGFR: -2.9 ± 18.2 ml/min/1.73 m2) and CKD stage remained the same or improved in 81% of patients. In 791 patients with complete treatment course capture, patients had received 8.7 ± 13.8 infusions (median: 3, IQR: 2-10). Of these, 189 (24%) patients received only 1 pegloticase infusion and 173 (22%) received ≥12 infusions. As the data cut-off for this analysis pre-dated emerging data on the use of immunomodulation as co-therapy, only 19 of 791 (2%) patients received immunomodulation co-therapy with pegloticase.Conclusion:This relatively large group of patients with uncontrolled gout treated with pegloticase had similar patient characteristics of those studied in the phase 3 randomized clinical trials. Patients with uncontrolled gout are significantly burdened with systemic co-morbid diseases. The majority of patients had stable or improved kidney function following pegloticase treatment. As these results reflect patients initiating treatment prior to 2018, before co-treatment with immunomodulation was introduced, this cohort only included a small percentage of patients who were co-treated with an immunomodulator. Future studies using more current datasets are needed to evaluate real world outcomes in patients treated with pegloticase/immunomodulator co-therapy and to evaluate the impact of systemic co-morbid diseases.References:[1]Chen-Xu M, et al. Arthritis Rheumatol 2019 71:991-999.[2]Fels E, Sundy JS. Curr Opin Rheumatol 2008;20:198-202.[3]Sundy J, et al. JAMA 2011;306:711-720.[4]Mandell BF, et al. Arthritis Res Ther 2018;20:286.Disclosure of Interests:Claudia Vesel Shareholder of: Horizon Therapeutics plc, Employee of: Horizon Therapeutics plc, Allan Morton Speakers bureau: Sanofi, Amgen, and Horizon, Megan Francis-Sedlak Shareholder of: Horizon Therapeutics plc, Employee of: Horizon Therapeutics plc, Brian LaMoreaux Shareholder of: Horizon Therapeutics plc, Employee of: Horizon Therapeutics plc.



Author(s):  
Sebastian Eisele ◽  
Fabian M. Draber ◽  
Steffen Grieshammer

First principles calculations and Monte Carlo simulations reveal the impact of defect interactions on the hydration of barium-zirconate.



2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Obinna Ikechukwu Ekwunife ◽  
Chinelo Janefrances Ofomata ◽  
Charles Ebuka Okafor ◽  
Maureen Ugonwa Anetoh ◽  
Stephen Okorafor Kalu ◽  
...  

Abstract Background In sub-Saharan Africa, there is increasing mortality and morbidity of adolescents due to poor linkage, retention in HIV care and adherence to antiretroviral therapy (ART). This is a result of limited adolescent-centred service delivery interventions. This cost-effectiveness and feasibility study were piggybacked on a cluster-randomized trial that assessed the impact of an adolescent-centred service delivery intervention. The service delivery intervention examined the impact of an incentive scheme consisting of conditional economic incentives and motivational interviewing on the health outcomes of adolescents living with HIV in Nigeria. Method A cost-effectiveness analysis from the healthcare provider’s perspective was performed to assess the cost per additional patient achieving undetected viral load through the proposed intervention. The cost-effectiveness of the incentive scheme over routine care was estimated using the incremental cost-effectiveness ratio (ICER), expressed as cost/patient who achieved an undetectable viral load. We performed a univariate sensitivity analysis to examine the effect of key parameters on the ICER. An in-depth interview was conducted on the healthcare personnel in the intervention arm to explore the feasibility of implementing the service delivery intervention in HIV treatment hospitals in Nigeria. Result The ICER of the Incentive Scheme intervention compared to routine care was US$1419 per additional patient with undetectable viral load. Going by the cost-effectiveness threshold of US$1137 per quality-adjusted life-years suggested by Woods et al., 2016, the intervention was not cost-effective. The sensitivity test showed that the intervention will be cost-effective if the frequency of CD4 count and viral load tests are reduced from quarterly to triannually. Healthcare professionals reported that patients’ acceptance of the intervention was very high. Conclusion The conditional economic incentives and motivational interviewing was not cost-effective, but can become cost-effective if the frequency of HIV quality of life indicator tests are performed 1–3 times per annum. Patients’ acceptance of the intervention was very high. However, healthcare professionals believed that sustaining the intervention may be difficult unless factors such as government commitment and healthcare provider diligence are duly addressed. Trial registration This trial is registered in the WHO International Clinical Trials Registry through the WHO International Registry Network (PACTR201806003040425).



Sign in / Sign up

Export Citation Format

Share Document