scholarly journals The Consistency Testing and Improving of A Hematuria Colorimetric Card

2021 ◽  
Author(s):  
Wei Wang ◽  
Luping Shi ◽  
Jianghui Zhang ◽  
Li Ding ◽  
Yun Dai ◽  
...  
Keyword(s):  
Observer Agreement ◽  
Gross Hematuria ◽  
Consistency Test ◽  
Evaluation Standard ◽  
Consistency Results ◽  
Kappa Value ◽  
Random Number Table ◽  
High Consistency ◽  
Color Scales ◽  
Standard Color

Abstract Background: A Hematuria colorimetric card could unify the description of gross hematuria, but the consistency in assessing hematuria samples of a hematuria colorimetric card for gross hematuria is still inconclusive. The consistency testing and improving of hematuria colorimetric card has potential clinical application value.Methods: According to 6 color scales (0~5), 31 hematuria samples were made. One sample was used to explain the use of hematuria colorimetric cards, and then the evaluator was asked to describe the color. After the remaining 30 samples were arranged in a random number table, 30 evaluators independently completed the hematuria sample assessment under the same conditions. Kendall W coordination coefficient was used to test inter-observer consistency. After 1 hour, 30 hematuria samples were rearranged by random digital table method, 15 of which were randomly selected from 30 evaluators, and 30 samples were evaluated independently under the same conditions. Adopt the method of Kappa to test the consistency of the two evaluation results. Results: In the study, the evaluator lacked unity in describing the same hematuria color, including six groups of descriptive words: gross hematuria, light blood, light red, blood, scarlet, carmine. Inter-observer (inter-group) consistency test, Kendall coordination factor was 0.881(F=766.34), P<0.05), the result indicats higher inter-observer agreement. For intra-observer (intra-group) consistency test, the kappa value of nurses was 0.909~1(P<0.05), the value of doctors was 0.818~0.95(P<0.05), and the value of students was 0.863~0.911(P<0.05), the results showed that intra-observer agreement was also high. Consistency results between grade evaluation results of hematuria samples and standard color numbers: the average consistency of evaluation results of standard color numbers 0~5 was 100%, 100%, 94.2%, 65.2%, 38%, 65.8% respectively. The the 4th color block with low discrimination in the primary hematuria colorimetric card was eliminated, and the 5th color block was reassigned to 4th. Thus the modified hematuria colorimetric card was divided into 5 grades.Conclusions: The improved hematuria colorimetric card has good consistency in hematuria evaluation and is an effective tool for evaluating hematuria grade, which is helpful to unify the evaluation standard of gross hematuria grade.

The Kappa Coefficient and the Prevalence of a Diagnosis

1988 ◽  
Vol 27 (04) ◽  
pp. 184-186 ◽  
Author(s):  
Thomas Gjørup
Keyword(s):  
Kappa Coefficient ◽  
Observer Agreement ◽  
General Statement ◽  
Kappa Value

SummaryThe kappa coefficient is a widely used measure of agreement between observers’ independent recording of diagnoses. Kappa adjusts the overall agreement for expected chance agreement. The dependence of kappa on the prevalence . of a diagnosis has not previously been emphasized. This dependence means that kappa does not give a general statement of the reproducibility of a diagnosis. The result of a study of observer agreement should, therefore, not – as it has been done in several studies – be given by the kappa value alone. The kappa value should always be given together with the original results of the study.

Percentage of Inadequate Phlebograms and Observer Agreement in Thromboprophylactic Multicenter Trials Using Standardized Methodology and Central Assessment

1996 ◽  
Vol 76 (06) ◽  
pp. 0893-0896 ◽  
Author(s):  
P Kälebo ◽  
S Ekman ◽  
S Lindbratt ◽  
B I Eriksson ◽  
U Pauli ◽  
...  
Keyword(s):  
Standard Method ◽  
Observer Agreement ◽  
Observer Variability ◽  
Intraobserver Agreement ◽  
Multicenter Trials ◽  
Kappa Value

SummaryThis study examines inadequacy rates for phlebography in two multicenter trials for the prevention of post-operative DVT and determines inter- and intra-observer variability in evaluating phlebograms. A total of 991 (I) and 385 (II) patients underwent bilateral phlebography in two studies of thromboprophylaxis. Phlebography was performed using a standard method designed to visualize and assess all deep veins. Each vein was scored as normal, DVT or inadequate by both local and central assessment. The study showed low inadequacy rates for phlebograms of 12.2% (121/991) and 6.5% (25/385). Inter-observer agreement (local vs. central assessment) was moderate in both studies (1:74.8%, Kappa-value 0.41; II: 82.6%, Kappa-value 0.51). Good intraobserver agreement (within the central assessment group) was observed (I: 88.8%, Kappa-value 0.75). This study demonstrates low inadequacy rates for phlebograms using a standardized methodology and superior intra-observer agreement compared to inter-observer agreement and supports the importance of central assessment of phlebograms in thromboprophylactic multicenter trials to reduce observer variability.

Agreement and reproducibility in identification of endometriosis using magnetic resonance imaging

2010 ◽  
Vol 51 (5) ◽  
pp. 573-580 ◽  
Author(s):  
Luca Saba ◽  
Stefano Guerriero ◽  
Rosa Sulcis ◽  
Silvia Ajossa ◽  
Gianbenedetto Melis ◽  
...  
Keyword(s):  
Magnetic Resonance Imaging ◽  
Magnetic Resonance ◽  
Observer Agreement ◽  
Rectovaginal Septum ◽  
Resonance Imaging ◽  
Complete Mapping ◽  
Uterosacral Ligaments ◽  
Kappa Value ◽  
Pouch Of Douglas ◽  
Magnetic Resonance Imaging Mri

Background: Magnetic resonance imaging (MRI) is a promising technique in the study of endometriosis, allowing a complete mapping of lesions before surgery. However, the value of MRI in the diagnosis of endometriosis in the bladder, in superficial peritoneal lesions, and in ovarian foci and uterosacral ligaments is still under debate. Purpose: To assess inter- and intra-observer agreement in the evaluation of endometriosis in different anatomical locations using MRI. Material and Methods: From June 2006 to February 2008, 83 female patients (mean age 39, range 19–49 years) who had undergone MRI examination for suspected endometriosis were evaluated by two radiologists. MRI at 1.5 Tesla was performed with SE and TSE sequences, T1- and T2-weighted with and without fat suppression. Each examination was completed with gadolinium administration. Each dataset was independently evaluated by the radiologists for the presence or absence of endometriosis. The location (ovaries, uterosacral ligaments (USLs), pouch of Douglas, vagina, rectosigmoid, rectovaginal septum, and bladder) of suspected lesions was recorded. Cohen kappa statistical analysis was performed to calculate agreement between measurements. After 2 months the data were analyzed again by the two observers to assess intra-observer agreement. Results: Of the 83 MRI examinations performed, 12 patients demonstrated no evidence of endometriosis. In the remaining 71 studies, 157 endometriotic lesions ranging in size from 0.4 to 6.2 cm were detected. Of the 157 lesions, 53 (33.75% incidence) were smaller than 1 cm. In the ovaries, the inter-observer agreement was 92.77% and the kappa value was 0.802 (95% CI, 0.695–0.91). In the bladder the inter-observer agreement was 96.39% and the kappa value was 0.553 (95% CI 0.056–1). In the USLs the inter-observer agreement was 90.96% and the kappa value 0.583 (95% CI, 0.381–0.784). In the rectovaginal septum the inter-observer agreement was 94.58% and the kappa value 0.739 (95% CI, 0.572–0.905). In the rectovaginal pouch the inter-observer agreement was 88.55% and the kappa value 0.608 (95% CI, 0.443–0.774). In the vaginal fornix the inter-observer agreement was 94.58% and the kappa value 0.726 (95% CI, 0.552–0.901). In the rectosigmoid the inter-observer agreement was 89.76% and the kappa value 0.589 (95% CI, 0.389–0.768). Conclusion: The results of our study indicate that MRI has a high inter- and intra-observer agreement in the identification of endometriosis located in the ovary, rectosigmoid, and rectovaginal septum, whereas the agreement is suboptimal for the identification of endometriosis located in the USLs.

scholarly journals INTER-OBSERVER AGREEMENT IN INTERPRETING UROFLOWMETRY MEASUREMENTS IN INDONESIA

2021 ◽  
Vol 28 (1) ◽  
pp. 8-13
Author(s):  
I Made Suyadnya ◽  
Yacobda Sigumonrong
Keyword(s):  
Patient Care ◽  
Flow Curve ◽  
Kappa Statistic ◽  
Fair Agreement ◽  
Observer Agreement ◽  
Patient Treatment ◽  
Poor Agreement ◽  
The Poor ◽  
Grade Classification ◽  
Kappa Value

Objective: We evaluated the comparability and repeatability of analyses based on uroflowmetry reports among urologists in Indonesia. Material & Methods: We assessed the inter-observer agreement when interpreting urodynamic examinations. Four urologists analyzed 20 sets of uroflowmetry data and gave their interpretations of the normality of the curve, reason of abnormality, grade classification, and pattern of the uroflowmetry curves. The consensus among observers was analyzed using the kappa statistic. Results: The kappa values for the analyses of the normality of the curves indicated fair to the moderate agreement. Agreement on the reason of abnormality showed poor to fair consensus. The shape of the flow curve had kappa values ranging from 0.047 to 0.225, indicating poor to fair consensus. Based on grade also showed kappa value from 0.047 to 0.169, indicating a poor agreement. Conclusion: Interpretations of uroflowmetry tracings showed only the poor to a fair agreement despite the normality of the uroflow curve. Variability in interpretation can strongly impact patient treatment. Therefore, further work is needed to standardize the reporting and interpretation of uroflowmetry studies to optimize patient care.

Comparison of Pre- and Postoperative Histopathology Results in Patients with Endometrial Carcinoma

2021 ◽  
Author(s):  
Yinglan Zhang ◽  
Yu Zhao ◽  
Yuan Li
Keyword(s):  
Endometrial Carcinoma ◽  
Clinical Data ◽  
Preoperative Diagnosis ◽  
Preoperative Assessment ◽  
Weighted Kappa ◽  
Cross Sectional ◽  
Significant Difference ◽  
Kappa Value ◽  
Grade 3 ◽  
High Consistency

Abstract Background: Preoperative histopathology is considered the most effective method for evaluation of endometrial carcinoma, and plays a crucial role in deciding the extent of surgical resection. In this study, we analysed clinical data to evaluate the accuracy of preoperative diagnosis by comparing preoperative hysteroscopic biopsy results with postoperative histopathological results. Methods: This was a cross-sectional, retrospective study of patients who underwent hysteroscopic biopsy and subsequent hysterectomy for endometrial carcinoma. Clinical data were collected for 289 patients who were diagnosed with endometrial carcinoma based on hysteroscopy. We compared the histotype and tumour differentiation grade to evaluate the accuracy of diagnosis based on preoperative hysteroscopic biopsy.Results: Compared with the postoperative histotype results, the overall accuracy of the preoperative histotype results was 94.8%, and the kappa value was 0.725 (p < 0.001). The weighted kappa value for agreement between preoperative and postoperative histopathological grade was 0.616, indicating the level of agreement was “substantial” (95% CI 0.538–0.695). The rate of misdiagnosis based on hysteroscopy was significantly higher for grade 3 cancer than for grade 1 cancer, and there was no significant difference for grade 2 cancer compared with the other two grades.Conclusions: Hysteroscopy is a reliable method for preoperative diagnosis of endometrial carcinoma. Preoperative assessment of histotype by hysteroscopy showed high consistency with postoperative results. However, there was a significantly higher rate of misdiagnosis for patients with poorly differentiated tumour, which may lead to overtreatment. For these patients, we recommend analysing frozen sections before determining a final treatment strategy.

UNIVERSALLY BAIRE SETS AND GENERIC ABSOLUTENESS

2017 ◽  
Vol 82 (4) ◽  
pp. 1229-1251
Author(s):  
TREVOR M. WILSON
Keyword(s):  
Measurable Cardinal ◽  
Consistency Strength ◽  
Woodin Cardinals ◽  
Generic Absoluteness ◽  
Relative Consistency ◽  
Consistency Results ◽  
High Consistency ◽  
Image Position ◽  
General Method

AbstractWe prove several equivalences and relative consistency results regarding generic absoluteness beyond Woodin’s ${\left( {{\bf{\Sigma }}_1^2} \right)^{{\rm{u}}{{\rm{B}}_\lambda }}}$ generic absoluteness result for a limit of Woodin cardinals λ. In particular, we prove that two-step $\exists ^&#x211D; \left( {{\rm{\Pi }}_1^2 } \right)^{{\rm{uB}}_\lambda } $ generic absoluteness below a measurable limit of Woodin cardinals has high consistency strength and is equivalent, modulo small forcing, to the existence of trees for ${\left( {{\bf{\Pi }}_1^2} \right)^{{\rm{u}}{{\rm{B}}_\lambda }}}$ formulas. The construction of these trees uses a general method for building an absolute complement for a given tree T assuming many “failures of covering” for the models $L\left( {T,{V_\alpha }} \right)$ for α below a measurable cardinal.

Reproducibility of radiographic classification of scapholunate advanced collapse (SLAC) and scaphoid nonunion advanced collapse (SNAC) wrist

2013 ◽  
Vol 38 (7) ◽  
pp. 780-787 ◽  
Author(s):  
K. Vishwanathan ◽  
A. Hearnden ◽  
S. Talwalkar ◽  
M. Hayton ◽  
S. R. Murali ◽  
...  
Keyword(s):  
Weighted Kappa ◽  
Observer Agreement ◽  
Scaphoid Nonunion ◽  
Kappa Value ◽  
Snac Wrist ◽  
Level Of Agreement ◽  
Slac Wrist ◽  
Radiographic Classification

The aim of this study was to measure inter- and intra-observer agreement on the radiographic classification of scapholunate advanced collapse (SLAC) and scaphoid nonunion advanced collapse (SNAC) wrist. Radiographs of 41 patients with SLAC wrist and 47 patients with SNAC wrist were graded on two separate occasions by four orthopaedic consultants specializing in hand and wrist surgery. Inter-observer agreement was evaluated using the multi-rater kappa value. Landis and Koch criteria were used to assess the level of agreement. Intra-observer agreement was tested by re-grading the radiographs after an interval of 2 to 4 weeks and calculating the weighted kappa value. For SLAC wrist, the inter-observer agreement was moderate (kappa value = 0.59) and intra-observer agreement substantial (kappa value = 0.65). For SNAC wrist, the inter-observer agreement was slight (kappa value = 0.20) and intra-observer agreement was fair (kappa value = 0.29). Radiographic classification of SLAC wrist has moderate reliability and reproducibility, whereas classification of SNAC wrist has limited reliability.

scholarly journals Application Value of SAT-TB Combined with Acid-Fast Staining in the Diagnosis and Treatment of Pulmonary Tuberculosis

2020 ◽  
Vol 2020 ◽  
pp. 1-5
Author(s):  
Chaochao Qiu ◽  
Ning Pan ◽  
Yueying Zhou ◽  
Hongye Ning ◽  
Xinchun Ye ◽  
...  
Keyword(s):  
Pulmonary Tuberculosis ◽  
Positive Predictive Value ◽  
Predictive Value ◽  
Gold Standard ◽  
Diagnosis And Treatment ◽  
Significant Difference ◽  
Kappa Value ◽  
High Consistency ◽  
Sensitivity Specificity ◽  
Acid Fast Staining

Objectives. This study is aimed at evaluating the clinical application value of RNA simultaneous amplification and testing method for Mycobacterium tuberculosis (SAT-TB) combined with acid-fast staining in the diagnosis and treatment of pulmonary tuberculosis (PTB). Methods. This paper included 168 suspected and confirmed PTB sufferers admitted to The Sixth People’s Hospital of Wenzhou from December 2018 to December 2019, whose sputum was collected and tested using SAT-TB, smear acid-fast staining method, and the BACTEC MGIT 960 system. With the MGIT 960 culture test method as the gold standard, the application value of SAT-TB, acid-fast staining, or SAT-TB combined with acid-fast staining in the diagnosis and treatment of PTB was assessed. Results. With the MGIT 960 culture as the gold standard, the sensitivity, specificity, positive predictive value, and negative predictive value of SAT-TB for the diagnosis of PTB were 57.3%, 92.5%, 84.3%, and 73.5%, respectively. The conformity was 76.8%, and the Kappa value was 0.515, suggesting a statistically significant difference ( χ 2 = 7.314 , p < 0.05 ) and a general consistency degree. Additionally, the sensitivity, specificity, positive predictive value, and negative predictive value of SAT-TB combined with sputum smear acid-fast staining were 81.3%, 86.0%, 88.4%, and 80.8%, respectively, with the MGIT 960 culture still the gold standard. The conformity and Kappa value were 83.9% and 0.672, respectively, showing no statistically significant difference ( χ 2 = 0.438 , p > 0.05 ) and a relatively high consistency degree. Conclusion. SAT-TB combined with acid-fast staining had a similar detection rate to that of the MGIT 960 culture test with a high consistency degree, which could be applied in the diagnosis of PTB efficiently and accurately.

scholarly journals Lateral throat form classification using a customized gauge and Neil’s method – a comparative study

2018 ◽  
Vol 8 (4) ◽  
pp. 54-57
Author(s):  
Sabina Poudel ◽  
Minu Dhungana ◽  
Rajani Karki ◽  
Prabhat Shrestha
Keyword(s):  
Geriatric Patients ◽  
Observer Variation ◽  
Observer Agreement ◽  
Cohen’S Kappa ◽  
Kappa Test ◽  
Cohen's Kappa ◽  
Kappa Value ◽  
Edentulous Patients ◽  
Observer Accuracy ◽  
Good Agreement

Introduction: Lateral throat form (LTF) is the critical area which has to be recorded properly for obtaining proper retention and stability in complete denture especially in geriatric patients with resorbed ridges. Popular method used for determining LTF is Neil’s method which depends on the forces applied by the floor of mouth when the tongues protrude out. Since the perception of the forces differs among different operators, there are high chances of error in the classification. So, customized instrument was fabricated to prevent this inter-observer variation. The aim of the study was to compare the inter-observer accuracy between Neil’s method of classifi­cation and classification done by customized gauze. Methods and methodology: Total 30 edentulous patients were taken. Two observers measured the LTF depth by customized tool and also by Neil’s method. Cohen’s kappa test was used to evaluate the agreement between two operators in two different classifications. Result: The agreement between the two observers was evaluated by means of Cohen’s kappa value. There was good agreement between observers in proposed classification done by customized tool with kappa value 0.658 and fair inter-observer agreement with kappa value 0.0492. Conclusion: The method of measuring the depth of LTF with fabricated instrument was more accurate and reliable than Neil’s method.

scholarly journals The technology of artificial pneumoperitoneum CT and its application in diagnosis of abdominal adhesion

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Gui-sheng Wang ◽  
Zhi-yi Zhang ◽  
Xue-ting Qi ◽  
Jin Liu ◽  
Ting Liu ◽  
...  
Keyword(s):  
Surgical Results ◽  
Abdominal Adhesions ◽  
Widespread Application ◽  
Consistency Test ◽  
Kappa Test ◽  
Good Imaging ◽  
Imaging Results ◽  
Peritoneal Space ◽  
High Consistency ◽  
Sensitivity Specificity

AbstractTo retrospectively analyze the use of artificial pneumoperitoneum in CT scans, to explore its operation methods and technical points, and to lay the foundation for the widespread application of artificial pneumoperitoneum in CT. A total of 331 patients who underwent artificial pneumoperitoneum with CT angiography from January 1, 2013, to November 1, 2019, were recruited. All patients underwent standardized artificial pneumoperitoneum in the horizontal, left and right lateral, and prone positions during CT thin-layer scans of the abdomen and 3D reconstruction. Taking the surgical results as the gold standard, and using kappa test to verify the consistency of surgical results and imaging results. In all 331 patients, 43 patients had a normal peritoneal space, and 288 patients had an abnormal peritoneal space. And only 22 patients developed complications of subcutaneous emphysema, accounting for 6.6% of all 331 patients. In terms of the postoperative results, 28 were normal, and 303 were abnormal. The sensitivity, specificity and accuracy of CT diagnosis of abdominal adhesions using artificial pneumoperitoneum were 100%, 95.04%, and 95.46%, respectively. According to the Kappa consistency test, the imaging diagnosis from the CT scan with artificial pneumoperitoneum had a high consistency with the surgical results (kappa = 0.796, P < 0.05). The technique of artificial pneumoperitoneum CT is safe, reliable, highly practical, and proficient for obtaining good imaging results. It provides a good imaging basis for the diagnosis of intra-abdominal diseases, especially intra-abdominal adhesions.

Sign in / Sign up

Export Citation Format

Share Document