Dignity therapy intervention fidelity: a cross-sectional descriptive study with older adult outpatients with cancer

Objectives Intervention fidelity is imperative to ensure confidence in study results and intervention replication in research and clinical settings. Like many brief protocol psychotherapies, Dignity Therapy lacks sufficient evidence of intervention fidelity. To overcome this gap, our study purpose was to examine intervention fidelity among therapists trained with a systematized training protocol. Methods For preliminary fidelity evaluation in a large multi-site stepped wedge randomized controlled trial, we analyzed 46 early transcripts of interviews from 10 therapists (7 female; 7 White, 3 Black). Each transcript was evaluated with the Revised Dignity Therapy Adherence Checklist for consistency with the Dignity Therapy protocol in terms of its Process (15 dichotomous items) and Core Principles (6 Likert-type items). A second rater independently coded 26% of the transcripts to assess interrater reliability. Results Each therapist conducted 2 to 10 interviews. For the 46 scored transcripts, the mean Process score was 12.4/15 (SD = 1.2), and the mean Core Principles score was 9.9/12 (SD = 1.8) with 70% of the transcripts at or above the 80% fidelity criterion. Interrater reliability (Cohen’s kappa and weighted kappa) for all Adherence Checklist items ranged between .75 and 1.0. For the Core Principles items, Cronbach’s alpha was .92. Conclusions Preliminary findings indicate that fidelity to Dignity Therapy delivery was acceptable for most transcripts and provide insights for improving consistency of intervention delivery. The systematized training protocol and ongoing monitoring with the fidelity audit tool will facilitate consistent intervention delivery and add to the literature about fidelity monitoring for brief protocol psychotherapeutic interventions.

Enabling #EEGManyLabs: Quality in Automatically Preprocessed EEG Data and Psychopathological Associations of Frontal Alpha Asymmetry

Neuroscience is facing a replication crisis. Little effort is invested in replication projects and low power in many studies indicates a potentially poor state of research. To assess replicability of EEG research, the #EEGManyLabs project aims to reproduce the most influential original EEG studies. A spin-off to the main project shall investigate the relationship between frontal alpha asymmetries and psychopathological symptoms, the predictive qualities of which have lately been considered controversial. To ensure that preprocessing of EEG data can be conducted automatically (via Automagic), we tested 47 healthy participants in an EEG resting state paradigm and collected psychopathological measures. We analyzed reliability and quality of manual and automated preprocessing and performed multiple regressions to investigate the association of frontal alpha asymmetries and depression, worry, trait anxiety and COVID-19 related worry. We hypothesized comparably good interrater reliability of preprocessing methods and higher data quality in automatically preprocessed data. We expected associations of leftward frontal alpha asymmetries and higher depression and anxiety scores and significant associations of rightward frontal alpha asymmetries and higher worrying and COVID-19- related worrying. Interrater reliability of preprocessing methods was mostly good, automatically preprocessed data achieved higher quality scores than manually preprocessed data. We uncovered an association of relative rightward lateralization of alpha power at one electrode pair and depressive symptoms. No further associations of interest emerged. We conclude that Automagic is an appropriate tool for large-scale preprocessing. Findings regarding associations of frontal alpha asymmetries and psychopathology likely stem from sample limitations and shrinking effect sizes.

Manual Testing of Respiratory Muscles in Adults with Asthma: A Intra and Interrater Reliability and Validity Study

Background: Manual Muscle Testing (MMT) is a useful tool to evaluate ventilatory mechanics in adults with asthma. However, in the reviewed literature, there are few studies that report psychometric features of this test. Therefore, the present study aimed to evaluate MMT reliability and validity in respiratory muscles in adults with asthma.Methods: It was a cross-sectional study. Muscle strength (MMT and static respiratory pressures), sociodemographic and anthropometric variables related to the disease were evaluated. Measurements were carried out by two independent evaluators The reliability of MMT was analyzed with the weighted kappa and the convergent validity was evaluated by comparing the MTT and the respiratory pressure measurements using Pearson's correlation coefficient. The level of significance was p <0.05. Results: Twenty-six adults with stable asthma participated in the study. The intrarater reliability for MMT was between moderate and substantial (kappa=0.45-0.88) for all evaluated muscles while the interrater reliability was slight and fair for intercostal muscles (kappa=0.07-0.24), and fair and substantial (kappa=0.36-0.75) for other muscles. The convergent validity of MMT and respiratory pressures was low (r=0.20-0.48).Conclusions: MMT is a reliable measurement that can be used to evaluate respiratory muscle strength in adults with asthma. This study support MMT application for respiratory muscles at clinical settings when more objective measures such as MIP and MEP are not available. Considering that the MMT is a useful, practical, low-cost tool commonly used by physiotherapists, future studies could evaluate the convergent validity compared with dynamometry or electromyography of the respiratory muscles.

Referral writing: Consensus building on a tool for writing structured referrals

Competency in referral writing skill is needed by doctors for which they are never trained. Although there is a lot of work done about improvement of consultation letters still priority is not given. There must be a course for teaching and learning medical referral writing skills to students along with the assessment. Currently there is such tool to assess the way communication letter are written. An 18-point assessment scale has been developed through Delphi technique to increase the quality of referral letters. The objective of the present study was to design a structured Performa for writing referrals, validated by 7 participants using Delphi. Results were finalised after the acceptance of structured referral by selected participants through Delphi. The response rate was 70%. The validity and interrater reliability were calculated using SPSS25. The Cronbach’s alpha was 0.7 and Kappa was 0.3. Both were statistically significant. The designed Performa for writing referrals, with its inter-rater reliability calculated, is best for writing effective and structured referrals. The study further recommending training junior doctors in making proper referrals. MeSH Words: Referral and consultation, improving quality and referral, Checklists and referrals and consultation.

The impact of medication reconciliation and review in patients using oral chemotherapy

Background and aim Verifying and reviewing a patients medication list can detect and reduce drug related problems (DRPs). However little is known about its effects in patients using oral chemotherapy. The aim of this study was to evaluate the impact of these interventions and the adapted Medication Appropriateness Index (aMAI) as a tool to carry out a medication review. Methods A case-control study was carried out. The hospital pharmacist performed a medication reconciliation and medication review, using the aMAI tool, in 54 patients starting oral chemotherapy. Discrepancies, DRP's and associated pharmaceutical interventions were reported via the electronic patient record (EPR). After one month, the acceptance rate was measured and the aMAI score recalculated. Kappa statistics were used to test intra- and interrater reliability. Results The medication list in the EPR was incomplete in 74,1% of patients with an average of 2.4 errors per patient. After medication review, the aMAI score decreased significantly from 7.2 to 5.4 (SD = 4,7; p <0.001), indicating an improvement in the appropriateness of the drugs patients were taking. Acceptance rates were 41,4% and 53,2% for advices resulting from medication reconciliation and medication review respectively. Kappa values of 0.90 and 0.70 respectively indicate good intra- and interrater reliability. Discussion and conclusion The study shows that medication reconciliation can identify and address discrepancies. Furthermore, medication review seems to ensure that drug treatment better meets patient needs. The aMAI was a reliable tool. Future research will have to determine the clinical relevance of these interventions.

Interrater Reliability of a Novel Goniometric Technique to Measure Scapular Protraction and Retraction

Importance: Scapular protraction and retraction are often essential for occupational performance; however, clinical assessment of these movements is uniquely challenging. Objective: To analyze the interrater reliability of a novel goniometric method to measure scapular protraction and retraction. Design: An observational, descriptive design was implemented to evaluate interrater reliability between two experienced occupational therapists who were also certified hand therapists. Setting: Academic institution. Participants: Convenience sample of graduate students (N = 80). Outcomes and Measures: The hypothesis, developed before study implementation, was that the technique would demonstrate clinically acceptable interrater reliability, defined as a standard error of measurement (SEM) &lt;8°. Goniometric measurements of the scapula at rest, in maximal protraction, and in maximal retraction were independently obtained from each participant by each evaluator. The goniometer was aligned on the scapula using the superior angle as the axis of motion to measure the movement of the acromion relative to the frontal plane. The SEM was calculated in each position using the intraclass correlation coefficient values and the average of the standard deviations from the two raters. Results: The SEM values between the two evaluators for the resting, protracted, and retracted positions were 3.46°, 2.93°, and 2.74°, respectively. Conclusions and Relevance: The SEM between the two evaluators for each scapular position was &lt;4°, suggesting that the technique may be clinically reliable. However, additional research regarding the reliability and validity of the technique is recommended. What This Article Adds: The findings of this study support the use of goniometry to measure scapular protraction and retraction in relation to occupational performance. The technique provides a way to quantify baseline scapular mobility and track progress.

Reliability Assessment and Validation of the Skin Hyperpigmentation Index Compared to the Physician Global Assessment Score

<b><i>Background:</i></b> The skin hyperpigmentation index (SHI), a new objective method for measuring skin hyperpigmentation, needs validation. <b><i>Objective:</i></b> To gain evidence of the reliability and validity of the SHI. <b><i>Methods:</i></b> Fifteen raters were divided into 3 groups (5 dermatologists, 5 nondermatologist physicians, and 5 nonphysician clinicians). Each rated 5 pigmented mole lesions with mild-to-severe hyperpigmentation to determine intra- and interrater reliability. All raters photographed the lesions and rated them using the subjective Physician Global Assessment (PGA) score. The same photographs were then assessed based on automatic computer measurement software using the online SHI tool (https://shi.skinimageanalysis.com). <b><i>Results:</i></b> The SHI reliability was excellent for all intra- and interrater assessments, while most PGA assessments showed good intra- and interrater agreement. Between-group reliability was excellent for SHI, while moderate-to-good for PGA evaluations. Concordance between the SHI and PGA assessments was strong across all groups of assessors. <b><i>Conclusion:</i></b> There is evidence that the SHI is a reliable instrument for measuring skin hyperpigmentation, and can be used by nonexperienced clinicians.

Addition of CT to Improve the Diagnostic Confidence for the Detection of Sacroiliac Joint Erosions in Patients with Equivocal MRI Findings

Purpose To determine if CT can improve the diagnostic confidence for the detection of sacroiliac joint (SIJ) erosions in patients with equivocal MRI findings. Methods A retrospective analysis of adult patients who had an SIJ MRI and a subsequent SIJ CT within 12 months was conducted. Using a 5-point Likert scale, two reviewers evaluated the de-identified MRI and CT images in randomized order and in separate sessions to answer the question: “Does the patient have SIJ erosions?”. A Fisher’s exact test was used to analyze the difference in diagnostic confidence, and intraclass correlation coefficient (ICC) was used to determine interrater reliability. Results 54 patients were included in the analysis (average age, 43.9 years). The average time interval between initial SIJ MRI and subsequent CT was 14.4 weeks (range, 5.6–50.3 weeks). CT resulted in significantly more cases with definitive diagnostic confidence than cases with probable or equivocal confidence compared to MRI ( P < .001). Amongst cases with equivocal findings on MRI, 73.2% of cases had definitive diagnoses on CT. There was moderate interrater agreement for MRI, with an ICC of .490 [95% CI, .258–.669], and excellent agreement for CT, with an ICC of .832 [95% CI, .728–.899]. Conclusion Overall, CT led to significantly increased diagnostic confidence and higher interrater reliability for the detection of SIJ erosions compared to MRI. Judicious use of CT may be useful in detecting SIJ erosions in patients with equivocal MRI findings.

CT-severity Score in COVID-19 patients, Assessment of Performance in Triage and Outcome Prediction: a Comparative Study of Different Methods

BACKGROUND: Lung involvement in COVID-19 can be quantified by chest CT scan with some triage and prognostication value. At least 7 CT-severity score (CTSS) systems have been proposed. PURPOSE: We evaluated triage and prognostication performance of seven different CTSSs for COVID-19. MATERIALS AND METHODS: COVID-19, PCR positive patients admitted from February 20th 2020 to July 22 were included into a retrospective study. Demographic data and clinical data indicating disease severity at presentation and in peak disease severity were recorded. CT images were reviewed and scored according to seven different scoring systems (CTSS1-CTSS7) by two radiologists. Interrater reliability was determined for each CTSS. Then clinical severity of the disease at presentation (for triage) and peak disease severity (for outcome) were compared with CTSSs separately. ROC curves for performance of each CTSS in diagnosing severe/critical disease on admission, severe/critical disease at peak disease severity and critical disease at peak severity were plotted. Areas under the curve (AUCs), best thresholds and corresponding sensitivities and specificities were calculated. RESULTS: 96 patients were included with mean age of 63.6 ± 17.4 years (range: 21-88, median: 67). 57 (59,4%) were men and 39 (40.6%) were women. All CTSSs showed good interrater reliability as calculated intraclass correlation coefficients (ICCs) were 0.764-0.837 for all of the CTSSs. Only three CTSSs showed acceptable AUCs (AUC =0.7) for triage of severe/critical patients. All CTSSs showed acceptable AUCs for prognostication (AUCs=0.76-0.79). Calculated AUCs were not significantly different for triage and for prediction of severe/critical disease but some difference was shown for prediction of critical disease. CONCLUSION: Men are probably affected more frequently than women by COVID19. CTSS performance in triage was much lower than earlier reports and only three CTSSs showed acceptable AUCs. CTSS performed better for prognostic purposes than for triage as all 7 CTSSs showed acceptable AUCs in both types of prognostic ROC curves. Our results are compatible with those of recent studies. There is not much difference among performance of different CTSSs.