scholarly journals Inter-Observer Agreement of a New Endoscopic Score for Ulcerative Colitis Activity: Preliminary Experience

Diagnostics ◽  
2020 ◽  
Vol 10 (4) ◽  
pp. 213
Author(s):  
Mariabeatrice Principi ◽  
Antonella Contaldo ◽  
Francesco Paolo Bianchi ◽  
Giuseppe Losurdo ◽  
Andrea Iannone ◽  
...  

Ulcerative colitis (UC) endoscopic scores translate mucosal damage into values standardizing image analysis. Due to potential limits of current endoscopic activity indexes, we have elaborated on a new score, the “Extended Mayo Endoscopic Score (EMES),” and evaluated its inter-observer agreement in a multicenter endoscopy team, comparing concordance with the Mayo subscore. Sixteen UC consecutive patients underwent follow-up colonoscopy. Recorded videos were anonymously loaded on a web platform. Thirteen expert endoscopists evaluated UC activity using both Mayo and EMES. EMES was described in every colon segment: erythema (0: absent, 1: mild, 2: moderate, 3: severe), vascular pattern (0: normal, 1: reduction, 2: disappearance), erosions and ulcers (0: absent, 1: from 1 to 5, 2: 6 to 10, 3: >10). Weighted Fleiss’ kappa with 95% confidence interval (CI) and p-value defined inter-rater agreement. Global inter-observer agreement of EMES was moderate (kappa = 0.56, 95% CI = 0.46–0.67, p < 0.001). The evaluation of each colonic segment showed moderate agreement for all segments: ascending (kappa = 0.46, 95% CI = 0.32–0.60, p < 0.001), transverse (kappa = 0.48, 95% CI = 0.29–0.67, p < 0.001); descending (kappa = 0.49, 95% CI = 0.35–0.64, p < 0.001), sigmoid (kappa = 0.52, 95% CI = 0.39–0.65, p < 0.001) and rectum (kappa = 0.55, 95% CI = 0.42–0.69, p < 0.001). Mayo subscore agreement was similar to global EMES (kappa = 0.53, 95% CI = 0.39–0.66, p = 0.001). Therefore, our report emphasizes the importance of assessing inter-observer agreement for EMES, but also for other known scoring systems, including the Mayo subscore.

Stroke ◽  
2017 ◽  
Vol 48 (suppl_1) ◽  
Author(s):  
Alex J Linn ◽  
Steve O’Donnell ◽  
Adam de Havenon

Introduction: Alberta Stroke Program Early CT Score (ASPECTS) is a validated clinical tool to predict early ischemic changes in acute ischemic stroke (AIS). In addition to scoring of non-contrast brain CT images (CT), head CT angiogram source images (CTA) have also been demonstrated as useful for scoring. We hypothesized that CTA ASPECTS would show superior inter-rater reliability as compared to CT ASPECTS, and that both would perform better in the setting of the favorable target mismatch (TM) profile on CT perfusion imaging (CTP). Methods: We reviewed AIS patients from 2010-2014 with an acute M1 middle cerebral artery occlusion that underwent CT, CTA, and CTP imaging at hospital admission. CT and CTA were independently scored by two experienced physician raters using the standard ASPECTS methodology. Inter-rater agreement was calculated with a weighted kappa. The cohort was then further stratified into either favorable or non-favorable TM profiles using volumetric measurements from the Olea Sphere software and the DEFUSE-3 definition of TM. Results: We included 68 patients. The mean±SD age was 62±18 years. 60% were men. The mean NIH stroke scale was 14.5±7.9. The median (IQR) follow-up modified Rankin Scale (mRS) was 3 (1,6). 37 of 68 (54%) patients had the TM profile and were significantly more likely to have lower follow-up mRS scores (z=3.5, p<0.001). Inter-rater agreement of CTA ASPECTS (kappa=0.82) was superior to CT ASPECTS (kappa=0.76). Patients with the TM profile demonstrated more reliable agreement on both CTA and CT ASPECTS scoring systems (kappa=0.79, 0.78), compared to those without the TM profile (kappa=0.71, 0.75). Discussion: We found that inter-rater agreement was higher for CTA ASPECTS as compared to CT ASPECTS and that both performed better in patents with the TM profile. Clinically this is important because it reaffirms the utility of CTA ASPECTS in this population of patients in which high reliability is paramount, as ASPECTS is often used in medical decision making when determining eligibility for medical and/or endovascular thrombolytic therapies.


2019 ◽  
Vol 3 (5) ◽  
pp. 216-221
Author(s):  
Lara Hart ◽  
Mallory Chavannes ◽  
Peter L Lakatos ◽  
Waqqas Afif ◽  
Alain Bitton ◽  
...  

Abstract Background Gastroenterologists should accurately describe endoscopic findings and integrate them into management plans. We aimed to determine if trainees and staff are describing inflammatory bowel disease (IBD) lesions in a similar manner. Methods Using 20 ileocolonoscopy images, participants described IBD inflammatory burden based on physician severity rating, and Mayo endoscopic score (MES) (ulcerative colitis [UC]) or simple endoscopic score (SES-CD) (Crohn’s disease [CD]). Images were selected based on agreement by three IBD experts. Findings of varying severity were presented; 10 images included a question about management. We examined inter-observer agreement among trainees and staff, compared trainees to staff, and determined accuracy of response comparing both groups to IBD experts. Results One hundred and twenty-nine staff and 47 trainees participated from across Canada. There was moderate inter-rater agreement using physician severity rating (κ = 0.53 UC and 0.52 CD for staff, κ = 0.51 UC and 0.43 CD for trainees). There was moderate inter-rater agreement for MES for staff and trainees (κ = 0.49 and 0.48, respectively), but fair agreement for SES-CD (κ = 0.37 and 0.32, respectively). For accuracy of response, the mean score was 68.7% for staff and 63.7% for trainees (P = 0.028). Both groups identified healed bowel or severe disease better than mild/moderate (P &lt; 0.05). There was high accuracy for management, but staff scored higher than trainees for UC (P &lt; 0.01). Conclusion Inter-rater agreement on description of IBD lesions was moderate at best. Staff and trainees more accurately describe healed and severe disease, and better describe lesions in UC than CD.


2021 ◽  
Vol 15 (Supplement_1) ◽  
pp. S315-S317
Author(s):  
F de Voogd ◽  
E Van Wassenaer ◽  
A Mookhoek ◽  
S Bots ◽  
S Van Gennep ◽  
...  

Abstract Background To assess disease activity in ulcerative colitis (UC) intestinal ultrasound (IUS) highly correlates with endoscopic outcomes. However, data on treatment response evaluated with IUS is limited. In this study we aim to evaluate bowel wall thickness (BWT) at follow-up to determine treatment effectiveness in moderate-severe UC patients treated with tofacitinib according to central read endoscopy and histology. Methods Patients with moderate-severe UC (endoscopic Mayo score (EMS)≥2) starting tofacitinib 10 mg bid were included. Disease activity was evaluated by recorded IUS cine-loops and video-taped endoscopies with biopsies from the sigmoid (SC) and descending colon (DC) at baseline and at 8 weeks. BWT and EMS were assessed per segment (SC and DC). Histology was scored for the SC with the Robarts Histology Index (RHI). BWT, EMS and RHI were centrally read and for IUS there was a second reader. Endoscopic remission (ERem) was defined as EMS=0, endoscopic improvement (EI) as EMS≤1 and endoscopic response (ERes) as a decrease of EMS≥1. For statistical analysis a Wilcoxon signed-rank and Spearman’s test were used. Area under the ROC was used to determine optimal cut-off values. Inter-observer agreement was analyzed by intra-class correlation coefficient (ICC). Results 29 patients were included and started tofacitinib. 10% reached complete ERem after 8 weeks, respectively. Per-segment analysis for EMS showed 22% and 53% reaching ER and 40% and 60% having EI in the SC and DC, respectively. BWT in SC and DC correlated highly with the EMS (rho=0.68, rho=0.75, both p&lt;0.0001) and moderately with RHI (rho=0.49, p=0.002). Patients with EMS≥2 after 8 weeks had an increased BWT (SC: 4.32 ± 1.57 mm, DC: 4.38 ± 1.58 mm) when compared to ERem (SC: 2.10 ± 0.67 mm, DC: mean: 2.00 ± 1.18 mm, both p&lt;0.0001) and EI (SC: 2.29 ± 0.76 mm, DC: 2.56 ± 1.38 mm, both p&lt;0.0001) in the similar segment (Figure 1 and 2). BWT decreased after 8 weeks when there was ERes (SC: mean: -2.59 ± 1.44 mm, DC: -1.82 ± 1.01 mm, both p=0.007) and did not when there was no ERes (Figure 3). BWT cut-off values for ERem are reported in Figure 4. Furthermore, agreement for BWT in the SC and DC was excellent (ICC: 0.92 and ICC: 0.89), respectively. Conclusion BWT reduction showed early endoscopic remission, improvement and response after 8 weeks of tofacitinib treatment and correlated with histology in this central read cohort. Furthermore, accurate and reliable cut-off values for BWT in SC and DC were found for endoscopic remission and improvement. Therefore, IUS should be incorporated in the standard follow-up and close monitoring of UC patients.


2021 ◽  
Vol 15 (Supplement_1) ◽  
pp. S515-S516
Author(s):  
D Rubstov ◽  
P Kakkadasam Ramaswamy ◽  
J Edwards ◽  
D Shukla ◽  
L Willmann ◽  
...  

Abstract Background Vedolizumab (VDZ) is a gut-specific α4β7 integrin antagonist that has demonstrated efficacy for induction and maintenance of remission in moderate to severe ulcerative colitis (UC). The aim of this study was to assess the rates of histological remission (HR) in a real-world setting and to identify predictors for histological remission. Methods Retrospective cohort study of all UC patients (≥18 years) initiated on VDZ from 2016 to 2020 was completed. Clinical, biochemical, endoscopic and histologic data were collected. All patients received standard induction therapy with VDZ 300 mg IV at Weeks 0, 2, and 6 and maintained on an 8-weekly regimen. Dose was escalated to a every 4-weekly regimen as per physician’s discretion. A 52-week follow-up was completed on all patients. Endoscopic assessment was carried out between 24 and 52 weeks after commencing VDZ. Histological activity was graded as per Nancy index and histological remission was defined as Nancy grade 0. Endoscopic remission was defined as Mayo endoscopic score = 0. Clinical remission was defined as SCCAI ≤ 5. Results A total of 51 patients [55% female, median age 48 years (IQR 35–60)] were included. 16/51 (34%) were anti-TNF exposed. In 30/51 (59%) patients VDZ was combined with steroids at induction and by week 12 steroids were completely tapered in 14/30 (46.7%) patients. At weeks 12, 24 and 52, 89.6%, 87% and 97.5% of patients, respectively, were in clinical remission. 19/37 (51.3%) patients were in endoscopic remission at end of follow up. Median Nancy score prior to commencing VDZ was 3 (IQR: 2–4) and the median Nancy score at end of follow up was 1 (IQR: 0–2). 19/37 (51.3%) patients achieved HR; 3 patients who were in HR at the time of commencement of VDZ remained in HR at the end of follow up. Median baseline faeces calprotectin (FC) was 320 mcg/g (IQR 45–1000) and was similar in patients who achieved HR and those who did not. Median FC at 12 weeks was 155 mcg/g (45–720) and was significantly lower in patients who achieved HR when compared to patients who did not achieve histological remission (45 vs 420, p 0.028). FC at week 12 predicted histological remission (AUC =0.8667). FC ≥ 200mcg/g at week 12 predicted failure to achieve HR with sensitivity 70%, specificity 100%, PPV 100%, NPV 75%, accuracy 84%. Conclusion Vedolizumab is effective in achieving histological remission and FC ≥ 200 mcg/g at week 12 accurately predicts failure to achieve HR in patients treated with VDZ.


2021 ◽  
Vol 12 (2) ◽  
pp. 217-224
Author(s):  
Cristiano Pagnini ◽  
Maria Carla Di Paolo ◽  
Benedetta Maria Mariani ◽  
Riccardo Urgesi ◽  
Lorella Pallotta ◽  
...  

The role of endoscopic evaluation in ulcerative colitis (UC) is well recognized, but a universally accepted gold standard for endoscopic activity evaluation is still lacking, and many scores have been proposed to this purpose. Among these, the Mayo Endoscopic Score (MES) and the Ulcerative Colitis Endoscopic Index (UCEIS) are currently the most used in trials and clinical practice. The aim of the study is to evaluate feasibility and performance of MES and UCEIS among expert endoscopists with no specific expertise in inflammatory bowel diseases (IBD), in a single hospital center. Two minutes video recordings, from colonoscopy of 12 UC patients, were observed and scored, according to MES and UCEIS, by seven hospital gastroenterologists with experience in digestive endoscopy and no particular expertise in IBD. Knowledge and utilization of the two scores were investigated. Inter-observer agreement and agreement with an IBD-expert gastroenterologist of the same center (central reader), and correlation between the two scores, was calculated. Among the endoscopists, MES was much more known and currently used than UCEIS. Both the scores displayed a similar good performance. Agreement with central reader was moderate for MES and UCEIS, and interobserver agreement was good, for both MES and UCEIS. Correlation between the two scores was very good both for central reader and for the hospital endoscopists. This single center study confirmed potential feasibility and usefulness of MES and UCEIS for assessment of endoscopic activity in UC patients in a real-life setting.


2021 ◽  
Vol 15 (Supplement_1) ◽  
pp. S524-S525
Author(s):  
L Wu ◽  
Y Zhang ◽  
Q Cao

Abstract Background The Ulcerative Colitis Endoscopic Index of Severity (UCEIS) and the Mayo Endoscopic Score (MES) were developed as an objective method of the endoscopic severity in ulcerative colitis (UC); however, it was still unclear whether UCEIS and MES could guide the mesalazine treatment in UC. Methods Consecutive UC patients who had undergone colonoscopy within 1 month before starting mesalazine between October 2011 and July 2016 were retrospectively evaluated. Demographic data, previous therapy, clinical observations, laboratory parameters, medical therapy and endoscopic assessments were documented. The primary outcome was the need for ‘step up’ treatment (containing the use of corticosteroids, immunomodulatory or surgery.) during admission and follow-up. Results Sixty-five patients were enrolled, 12(18.5%) needed ‘step up’ treatment’ due to primary or secondary nonresponse to mesalazine. UCEIS score is a predictor of primary or secondary nonresponse to mesalazine in multivariate analysis (OR, 25.65; 95% CI, 3.048–45.985; P =0.003). Receiver-operator characteristic (ROC) area of UCEIS is 0.95, with a sensitivity of 100% and specificity of 84.6%, using cut-off value of 6, which outperforms MES with the ROC area of 0.70; When UCEIS score ≥6, 60% of patients eventually need ‘step up’ treatment. Conclusion UCEIS score is a useful instrument for evaluating endoscopic improvement in UC patients treated with mesalazine. The high probability of mesalazine treatment failure and benefits of other therapy should be discussed in patients with baseline UCEIS ≥ 6.


2018 ◽  
Vol 22 (2) ◽  
pp. 106-111 ◽  
Author(s):  
Alexandra E Kovach ◽  
Dedrick E Moulton ◽  
Walton D Plummer ◽  
William D Dupont ◽  
M Cristina Pacheco

Detailed histologic scoring systems have been developed for the assessment of disease activity in ulcerative colitis. Literature from adult patients has shown some correlation between endoscopy and histology, and reproducibility of histologic scoring systems has also been supported. The effectiveness of endoscopic appearance at predicting histologic scores in pediatric patients has not been well studied, and none of the histologic scoring systems used in adults have had interobserver reproducibility assessed in pediatric patients. We reviewed endoscopic images and concurrent biopsies using Mayo and Geboes scores from the distal colon and rectum in untreated pediatric patients at the presentation of presumed ulcerative colitis based on clinical and endoscopic findings. Interobserver concordance was calculated by weighted-kappa statistic. The averaged histologic scores were compared to endoscopy scores using Spearman’s coefficient. Correlation between endoscopic score and each histologic score was weakly to moderately positive, whereas interobserver agreement for histologic scores was fair to moderate, suggesting that the Geboes scoring system has value in pediatric patients. For each histologic parameter, the average score was lower than the average endoscopic score. Examination of larger pediatric cohorts, treated patients, correlations of clinical outcomes with individual histologic parameters, and alternate scoring systems may contextualize these findings.


2021 ◽  
Vol 15 (Supplement_1) ◽  
pp. S427-S427
Author(s):  
N Picker ◽  
H Patel ◽  
T Wilke ◽  
L Rosin ◽  
B Bokemeyer

Abstract Background Advanced therapies used in moderate-to-severe Ulcerative Colitis (UC) may show a secondary loss of response (LOR) over time, requiring patients to undergo dose escalation or switching. Our study aimed to investigate the frequency of dose escalation in real-world practice and evaluated the associated cost. Methods Using German claims data (AOK PLUS) including prescription data, we identified UC patients by either at least two confirmed outpatient diagnoses or one primary inpatient diagnosis (ICD-10 K51). Analyzed patients initiated an advanced therapy (anti-TNF, vedolizumab, tofacitinib) between 01/01/2015-30/06/2019. Therapy escalation was defined as dose increase exceeding the recommended maintenance dose according to product labels by more than 150%. Time to first escalation was analyzed using a Kaplan-Meier estimation. The observation ended with the discontinuation of index therapy + 90 days, or loss to follow-up, whatever occurred first. End of therapy was determined in case of a supply gap of &gt;60 days or switch of the advanced therapy. Patients with a follow-up &lt; 6 months were excluded.Direct UC-related resource use and costs accounting for hospitalizations, outpatient treatment, drug costs according to pharmacy sales prices were reported per patient-year (PY). Results Among 574 UC patients who initiated an advanced therapy, 328 patients (median age: 37 years; female: 52.1%; biologic-naïve: 85.4%) with sufficient follow-up time (median: 12.2 months) were identified. Out of these, 59 patients (19%) were dose-escalated within the first year, whereas 73 patients (22%; anti-TNF: 61; vedolizumab: 12) were found to experience a therapy escalation during the whole follow-up time (average daily dose during maintenance therapy: adalimumab: 5.3 mg, infliximab: 14.6 mg, golimumab: 3.7 mg, vedolizumab: 11.1 mg, tofacitinib: n/a). Total observed direct cost related to UC amounted to €39,514/PY (95%-CI: 37,469-41,558), with €37,369/PY (34,852-39,885; Figure 1) caused by UC-related medication (95%). In comparison, UC-related total direct costs and drug costs for patients without any observable escalation were much lower (€30,425/PY [29,672-31,178]; p-value &lt;0.001 and €28,066/PY [27,230-28,902]; p-value &lt;0.001). Frequency of hospitalizations due to UC (0.3 [0.2-0.5] vs. 0.4 [0.3-0.5]; p-value: 0.947) and gastroenterologist visits (2.1 [1.6-2.6] vs. 2.3 [2.1-2.5]; p-value: 0.361) were similar among both groups. Conclusion Nearly one-fifth of observed patients required therapy escalation in the first year, most likely due to secondary LOR. This results in higher UC-related costs. Payers should consider rates and costs of dose escalations when evaluating the cost-effectiveness of advanced therapies.


2021 ◽  
Vol 15 (Supplement_1) ◽  
pp. S098-S098
Author(s):  
E Zittan ◽  
A H Steinhart ◽  
H Aran ◽  
R Milgrom ◽  
E Koifman ◽  
...  

Abstract Background Commonly used endoscopic indices in IBD lack ability to provide overall disease burden and severity, generate low inter-observer agreement, and demonstrate incomplete validation of some scores. We developed a new endoscopic reporting tool, the Toronto IBD Global Endoscopic Reporting (TIGER) score for Crohn’s disease (CD) and ulcerative colitis (UC) patients. The aim of our study was to compare the usability and validity of the TIGER score against fecal calprotectin (FC), C-reactive protein (CRP) and IBD DISK score in UC patients. Methods A cohort of 53 UC patients participated in the study. Blinded IBD experts reviewed and graded ileocolonoscopy videos. In the validation phase, the TIGER score was compared to (1) the Mayo endoscopic score serving as a reference standard and; (2) inflammatory biomarkers FC, CRP and; (3) IBD Disk. Results Inter-observer reliability of the TIGER score per segment between reviewers was excellent, Interclass Correlation Coefficient (ICC)=0.94; [95%CI: 0.92–0.96]. For categorized TIGER score, lowest overall agreement was 96.6% [95%CI: 93.5–98.6] and lowest kappa 0.91 [95%CI: 0.84–0.98], reflecting excellent agreement. Overall agreement per segment between Mayo endoscopic score and TIGER was 84% [95%CI:74%-90%] and kappa coefficient 0.60 [95%CI: 0.42–0.808]. Per subject analysis for UC yielded overall agreement of 80% [95%CI: 64–91] and kappa coefficient 0.44 [95%CI: 0.14–0.75]. There was a significant correlation between TIGER and FC (r s = .794, p &lt; .0001). There was a significant correlation between TIGER and IBD Disk (r s = .613, p &lt; .0001). As expected, there was a lower correlation between TIGER score and CRP (r s = .309, p &lt; .0850) in UC patients. Conclusion The TIGER endoscopic score demonstrates significant correlation with FC and IBD disk score in ulcerative colitis patients and thus can be used as a reliable and simple endoscopic score for UC patients to capture overall endoscopic disease burden.


Sign in / Sign up

Export Citation Format

Share Document