scholarly journals Using item response theory (IRT) to improve the efficiency of the Simple Clinical Colitis Activity Index (SCCAI) for patients with ulcerative colitis

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Alissa Walsh ◽  
Rena Cao ◽  
Darren Wong ◽  
Ramona Kantschuster ◽  
Lawrence Matini ◽  
...  
Keyword(s):  
Ulcerative Colitis ◽  
Item Response Theory ◽  
Disease Activity ◽  
Item Response ◽  
Activity Index ◽  
Response Theory ◽  
Faecal Calprotectin ◽  
Metric Properties ◽  
Initial Item ◽  
Item Scale

Abstract Background The SCCAI was designed to facilitate assessment of disease activity in ulcerative colitis (UC). We aimed to interrogate the metric properties of individual items of the SCCAI using item response theory (IRT) analysis, to simplify and improve its performance. Methods The original 9-item SCCAI was collected through TrueColours, a real-time software platform which allows remote entry and monitoring of patients with UC. Data were securely uploaded onto Dementias Platform UK Data Portal, where they were analysed in Stata 16.1 SE. A 2-parameter (2-PL) logistic IRT model was estimated to evaluate each item of the SCCAI for its informativeness (discrimination). A revised scale was generated and re-assessed following systematic removal of items. Results SCCAI data for 516 UC patients (41 years, SD = 15) treated in Oxford were examined. After initial item deletion (Erythema nodosum, Pyoderma gangrenosum), a 7-item scale was estimated. Discrimination values (information) ranged from 0.41 to 2.52 indicating selected item inefficiency with three items < 1.70 which is a suggested discriminatory value for optimal efficiency. Systematic item deletions found that a 4-item scale (bowel frequency day; bowel frequency nocturnal; urgency to defaecation; rectal bleeding) was more informative and discriminatory of trait severity (discrimination values of 1.50 to 2.78). The 4-item scale possesses higher scalability and unidimensionality, suggesting that the responses to items are either direct endorsement (patient selection by symptom) or non-endorsement of the trait (disease activity). Conclusion Reduction of the SCCAI from the original 9-item scale to a 4-item scale provides optimum trait information that will minimise response burden. This new 4-item scale needs validation against other measures of disease activity such as faecal calprotectin, endoscopy and histopathology.

scholarly journals Using Item Response Theory (IRT) to Improve the Efficiency of the Simple Clinical Colitis Activity Index (SCCAI) for Patients with Ulcerative Colitis

2020 ◽  
Author(s):  
Alissa Walsh ◽  
Rena Cao ◽  
Darren Wong ◽  
Ramona Kantschuster ◽  
Lawrence Matini ◽  
...  
Keyword(s):  
Ulcerative Colitis ◽  
Item Response Theory ◽  
Disease Activity ◽  
Item Response ◽  
Activity Index ◽  
Response Theory ◽  
Faecal Calprotectin ◽  
Metric Properties ◽  
Initial Item ◽  
Item Scale

Abstract BackgroundThe SCCAI was designed to facilitate assessment of disease activity in ulcerative colitis (UC). We aimed to interrogate the metric properties of individual items of the SCCAI using item response theory (IRT) analysis, to simplify and improve its performance. MethodsThe original 9-item SCCAI was collected through TrueColours, a real-time software platform which allows remote entry and monitoring of patients with UC. Data were securely uploaded onto Dementias Platform UK Data Portal, where they were analysed in Stata 16.1 SE. A 2-parameter (2-PL) logistic IRT model was estimated to evaluate each item of the SCCAI for its informativeness (discrimination). A revised scale was generated and re-assessed following systematic removal of items. ResultsSCCAI data for 516 patients (41 years, SD=15) were examined. After initial item deletion (Erythema nodosum, Pyoderma gangrenosum), a 7-item scale was estimated. Discrimination values (information) ranged from 0.41 to 2.52 suggesting selected item inefficiency. Systematic item deletions found that a 4-item scale (bowel frequency day; bowel frequency nocturnal; urgency; rectal bleeding) was more informative and discriminatory of trait severity (discrimination values of 1.50 to 2.78). The 4-item scale possesses higher scalability and unidimensionality, suggesting that the responses to items are either direct endorsement or non-endorsement of the trait (disease activity). Conclusion Reduction of the SCCAI from the original 9-item scale to a 4-item scale provides optimum trait information that will minimise response burden. This new 4-item scale needs validation against other measures of disease activity such as faecal calprotectin, endoscopy and histopathology.

scholarly journals Using Item Response Theory (IRT) to Improve the Efficiency of the Simple Clinical Colitis Activity Index (SCCAI) for patients with ulcerative colitis

2020 ◽  
Author(s):  
Alissa Walsh ◽  
Rena Cao ◽  
Darren Wong ◽  
Ramona Kantschuster ◽  
Lawrence Matini ◽  
...  
Keyword(s):  
Ulcerative Colitis ◽  
Item Response Theory ◽  
Disease Activity ◽  
Item Response ◽  
Activity Index ◽  
Response Theory ◽  
Faecal Calprotectin ◽  
Metric Properties ◽  
Initial Item ◽  
Item Scale

Abstract BackgroundThe SCCAI was designed to facilitate assessment of disease activity in ulcerative colitis (UC). We aimed to interrogate the metric properties of individual items of the SCCAI using item response theory (IRT) analysis, to simplify and improve its performance. MethodsThe original 9-item SCCAI was collected through TrueColours, a real-time software platform which allows remote entry and monitoring of patients with UC. Data were securely uploaded onto Dementias Platform UK Data Portal, where they were analysed in Stata 16.1 SE. A 2-parameter (2-PL) logistic IRT model was estimated to evaluate each item of the SCCAI for its informativeness (discrimination). A revised scale was generated and re-assessed following systematic removal of items. ResultsSCCAI data for 516 UC patients (41 years, SD=15) treated in Oxford were examined. After initial item deletion (Erythema nodosum, Pyoderma gangrenosum), a 7-item scale was estimated. Discrimination values (information) ranged from 0.41 to 2.52 indicating selected item inefficiency with three items <1.70 which is a suggested discriminatory value for optimal efficiency. Systematic item deletions found that a 4-item scale (bowel frequency day; bowel frequency nocturnal; urgency to defaecation; rectal bleeding) was more informative and discriminatory of trait severity (discrimination values of 1.50 to 2.78). The 4-item scale possesses higher scalability and unidimensionality, suggesting that the responses to items are either direct endorsement (patient selection by symptom) or non-endorsement of the trait (disease activity). Conclusion Reduction of the SCCAI from the original 9-item scale to a 4-item scale provides optimum trait information that will minimise response burden. This new 4-item scale needs validation against other measures of disease activity such as faecal calprotectin, endoscopy and histopathology.

scholarly journals Using Item Response Theory to Evaluate Self-directed Learning Readiness Scale

2017 ◽  
Vol 8 (1) ◽  
pp. 14
Author(s):  
Rana Th. Momani
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Response Theory ◽  
Self Directed Learning ◽  
Learning Readiness ◽  
Scale Levels ◽  
Directed Learning ◽  
Model Misfit ◽  
Discrimination Parameter ◽  
Item Scale

Item Response Theory becomes one of the most popular methods for instruments development and evaluation methods. This baseline study is a self-directed learning readiness (SDLR) 40 item scale with data from 648 undergraduate psychology female students attending Qassim University in Saudi Arabia through randomized selection to evaluate an SDLR scale at item and scale levels using GRM. Results provide more detailed diagnostic information to modulate the scale. GRM analysis led to the detection of two locally dependent items, one item with low discrimination parameter and 15 model misfit items. The scale often tends to measure low and moderate levels of SDLR. Advanced psychometric evaluations should be made and the SDLR scale must be reviewed based on quantitative and qualitative analysis.

Item-Response-Theory Analysis of Two Scales for Self-Efficacy for Exercise Behavior in People With Arthritis

2011 ◽  
Vol 19 (3) ◽  
pp. 239-248 ◽  
Author(s):  
Thelma J. Mielenz ◽  
Michael C. Edwards ◽  
Leigh F. Callahan
Keyword(s):  
Physical Activity ◽  
Older Adults ◽  
Item Response Theory ◽  
Item Response ◽  
Self Efficacy ◽  
Exercise Behavior ◽  
Response Theory ◽  
Item Response Theory Analysis ◽  
Graded Response ◽  
Item Scale

Benefits of physical activity for those with arthritis are clear, yet physical activity is difficult to initiate and maintain. Self-efficacy is a key modifiable psychosocial determinant of physical activity. This study examined two scales for self-efficacy for exercise behavior (SEEB) to identify their strengths and weaknesses using item response theory (IRT) from community-based randomized controlled trials of physical activity programs in adults with arthritis. The 2 SEEB scales included the 9-item scale by Resnick developed with older adults and the 5-item scale by Marcus developed with employed adults. All IRT analyses were conducted using the graded-response model. IRT assumptions were assessed using both exploratory and confirmatory factor analysis. The IRT analyses indicated that these scales are precise and reliable measures for identifying people with arthritis and low SEEB. The Resnick SEEB scale is slightly more precise at lower levels of self-efficacy in older adults with arthritis.

scholarly journals P122 High correlation between faecal calprotectin and a Novel Integral Index for evaluating disease activity in ulcerative colitis patients

2020 ◽  
Vol 14 (Supplement_1) ◽  
pp. S197-S197
Author(s):  
J K Yamamoto-Furusho ◽  
E A Mendieta-Escalante
Keyword(s):  
Ulcerative Colitis ◽  
Disease Activity ◽  
Intestinal Inflammation ◽  
Activity Index ◽  
P Value ◽  
The Novel ◽  
Integral Index ◽  
Full Spectrum ◽  
Faecal Calprotectin ◽  
Mayo Score

Abstract Background Ulcerative colitis (UC) is a chronic and incurable disease characterised by periods of activity and remission. There are several indexes that evaluate the UC activity from clinical, biochemical and endoscopic parameters. The faecal calprotectin is a non-invasive marker for detecting intestinal inflammation in UC patients. A new novel integral disease index (Yamamoto-Furusho index) includes clinical, biochemical, endoscopic and histological findings that evaluate the full spectrum of activity in UC patients. The aim is to correlate the Novel Index Activity index (Yamamoto-Furusho Index) with faecal calprotectin levels in UC patients and compare with other indexes. Methods A total of 158 patients with confirmed diagnosis of UC from the IBD Clinic were recruited in the period between July 2017 and June 2019. All demographic and clinical characteristics were collected from clinical charts. The faecal calprotectin was measured at least 1 week before the colonoscopy and biopsies. The Spearman’s Rho was used for the correlation. A p-value of &lt;0.05 was considered as significant. Results We analysed 185 patients with UC, 85 patients (51.8%) were women and 73 (44.5%) men, with an average current age of 43.53 years (+14.35), an age at diagnosis of 36.6 + 15.1 years and disease duration of 11.27 ± 8.1 years. The extension was distributed on proctitis (E1) in 13.3%, left colitis (E2) in 19.6% and pancolitis (E3) in 31.6%. The treatment was based on mesalazine in 93.9%, steroids in 26.2% and azathioprine in 15.9%. The correlation between faecal calprotectin and the Yamamoto–Furusho index was high (rho = 0.730, p &lt; 0.0001) compared with other indexes such as endoscopic Mayo sub-score (rho = 0.705, p = &lt;0.001); Truelove–Witts (rho = 0.644, p = &lt;0.001), Full Mayo score (rho = 0.708, p = &lt;0.001) and Montreal (rho = 0.551, p = &lt;0.001). Conclusion The novel integral index showed a high correlation with faecal calprotectin compared with other UC indexes for evaluating disease activity in UC patients.

Item Response Theory Analysis: PROMIS® Anxiety Form and Generalized Anxiety Disorder Scale

2021 ◽  
pp. 019394592110159
Author(s):  
Wen Liu ◽  
Lilian Dindo ◽  
Katherine Hadlandsmyth ◽  
George Jay Unick ◽  
M. Bridget Zimmerman ◽  
...  
Keyword(s):  
Anxiety Disorder ◽  
Item Response Theory ◽  
Item Response ◽  
Generalized Anxiety Disorder ◽  
Item Difficulty ◽  
Short Form ◽  
Generalized Anxiety ◽  
Response Theory ◽  
Patient Reported ◽  
Item Scale

Little research has compared item functioning of the Patient-Reported Outcomes Measurement Information System (PROMIS®) anxiety short form 6a and the generalized anxiety disorder 7-item scale using item response theory models. This was a secondary analysis of self-reported assessments from 67 at-risk U.S. military veterans. The two measures performed comparably well with data fitting adequately to models, acceptable item discriminations, and item and test information curves being unimodal and symmetric. The PROMIS® anxiety short form 6a performed better in that item difficulty estimates had a wider range and distributed more evenly and all response categories had less floor effect, while the third category in most items of the generalized anxiety disorder 7-item scale were rarely used. While both measures may be appropriate, findings provided preliminary information supporting use of the PROMIS® anxiety short form 6a as potentially preferable, especially for veterans with low-to-moderate anxiety. Further testing is needed in larger, more diverse samples.

scholarly journals A psychometric evaluation of the 12-item EPQ-R neuroticism scale in 502,591 UK Biobank participants using item response theory (IRT)

2020 ◽  
Author(s):  
Sarah Bauermeister ◽  
John Gallacher
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Psychometric Evaluation ◽  
Item Bias ◽  
Uk Biobank ◽  
Response Theory ◽  
Personality Dimension ◽  
Differential Item Function ◽  
Neuroticism Scale ◽  
Item Scale

Abstract Background Neuroticism has been described as a broad and pervasive personality dimension or ‘heterogeneous’ trait measuring components of mood instability such as worry; anxiety; irritability; moodiness; self-consciousness; sadness and irritabililty. Consistent with depression and anxiety-related disorders, increased neuroticism places an individual vulnerable for other unipolar and bipolar mood disorders. However, the measurement of neuroticism remains a challenge. Our aim was to identify psychometrically efficient items and inform the inclusion of redundant items across the 12-item EPQ-R Neuroticism scale using Item Response Theory (IRT). Methods The 12-item binary EPQ-R Neuroticism scale was evaluated by estimating a two-parameter (2-PL) IRT model on data from 502,591 UK Biobank participants aged 37 to 73 years (M = 56.53 years; SD = 8.05), 54% female. Models were run listwise (n= 401,648) and post-estimation mathematical assumptions were computed. All analyses were conducted in STATA 16 SE on the Dementias Platform UK (DPUK) Data Portal. Results A plot of θ values (Item Information functions) showed that most items clustered around the mid-range where discrimination values ranged from 1.34 to 2.28. Difficulty values for individual item θ scores ranged from -0.13 to 1.41. A Mokken analysis suggested a weak to medium level of monotonicity between the items, no items reach strong scalability (H=0.35-0.47). Systematic item deletions and rescaling found that an 7-item scale is more efficient and with information (discrimination) ranging from 1.56 to 2.57 and stronger range of scalability (H=0.47-0.52). A 3-item scale is highly discriminatory but offers a narrow range of person ability (difficulty). A logistic regression differential item function (DIF) analysis exposed significant gender item bias functioning uniformly across all versions of the scale. Conclusions Across 401,648 UK Biobank participants, the 12-item EPQ-R neuroticism scale exhibited psychometric inefficiency with poor discrimination at the extremes of the scale-range. High and low scores are relatively poorly represented and uninformative suggesting that high neuroticism scores derived from the EPQ-R are a function of cumulative mid-range values. The scale also shows evidence of gender item bias and future scale development should consider the former along with item deletions.

Development and Standardization of the Diagnostic Adaptive Behavior Scale: Application of Item Response Theory to the Assessment of Adaptive Behavior

2016 ◽  
Vol 121 (2) ◽  
pp. 79-94 ◽  
Author(s):  
Marc J. Tassé ◽  
Robert L. Schalock ◽  
David Thissen ◽  
Giulia Balboni ◽  
Henry (Hank) Bersani ◽  
...  
Keyword(s):  
Intellectual Disability ◽  
Item Response Theory ◽  
Item Response ◽  
Adaptive Behavior ◽  
Practical Skills ◽  
Item Pool ◽  
Response Theory ◽  
Initial Item ◽  
Behavior Scale ◽  
Nationally Representative

Abstract The Diagnostic Adaptive Behavior Scale (DABS) was developed using item response theory (IRT) methods and was constructed to provide the most precise and valid adaptive behavior information at or near the cutoff point of making a decision regarding a diagnosis of intellectual disability. The DABS initial item pool consisted of 260 items. Using IRT modeling and a nationally representative standardization sample, the item set was reduced to 75 items that provide the most precise adaptive behavior information at the cutoff area determining the presence or not of significant adaptive behavior deficits across conceptual, social, and practical skills. The standardization of the DABS is described and discussed.

Test Scaling and Value-Added Measurement

2009 ◽  
Vol 4 (4) ◽  
pp. 351-383 ◽  
Author(s):  
Dale Ballou
Keyword(s):  
Data Analysis ◽  
Item Response Theory ◽  
Item Response ◽  
Ordinal Data ◽  
Value Added ◽  
Interval Scale ◽  
Response Theory ◽  
Metric Properties ◽  
Ordinal Data Analysis ◽  
Ordinal Methods

Conventional value-added assessment requires that achievement be reported on an interval scale. While many metrics do not have this property, application of item response theory (IRT) is said to produce interval scales. However, it is difficult to confirm that the requisite conditions are met. Even when they are, the properties of the data that make a test IRT scalable may not be the properties we seek to represent in an achievement scale, as shown by the lack of surface plausibility of many scales resulting from the application of IRT. An alternative, ordinal data analysis, is presented. It is shown that value-added estimates are sensitive to the choice of ordinal methods over conventional techniques. Value-added practitioners should ask themselves whether they are so confident of the metric properties of these scales that they are willing to attribute differences to the superiority of the latter.

scholarly journals A psychometric evaluation of the 12-item EPQ-R neuroticism scale in 502,591 UK Biobank participants using item response theory (IRT)

2019 ◽  
Author(s):  
Sarah Bauermeister ◽  
John Gallacher
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Psychometric Evaluation ◽  
Item Bias ◽  
Uk Biobank ◽  
Response Theory ◽  
Personality Dimension ◽  
Differential Item Function ◽  
Neuroticism Scale ◽  
Item Scale

AbstractBackgroundNeuroticism has been described as a broad and pervasive personality dimension or ‘heterogeneous’ trait measuring components of mood instability such as worry; anxiety; irritability; moodiness; self-consciousness; sadness and irritabililty. Consistent with depression and anxiety-related disorders, increased neuroticism places an individual vulnerable for other unipolar and bipolar mood disorders. However, the measurement of neuroticism remains a challenge. Our aim was to identify psychometrically efficient items and inform the inclusion of redundant items across the 12-item EPQ-R Neuroticism scale using Item Response Theory (IRT).MethodsThe 12-item binary EPQ-R Neuroticism scale was evaluated by estimating a two-parameter (2-PL) IRT model on data from 502,591 UK Biobank participants aged 37 to 73 years (M = 56.53 years; SD = 8.05), 54% female. Models were run listwise (n= 401,648) and post-estimation mathematical assumptions were computed. All analyses were conducted in STATA 16 SE on the Dementias Platform UK (DPUK) Data Portal.ResultsA plot of θ values (Item Information functions) showed that most items clustered around the mid-range where discrimination values ranged from 1.34 to 2.28. Difficulty values for individual item θ scores ranged from −0.13 to 1.41. A Mokken analysis suggested a weak to medium level of monotonicity between the items, no items reach strong scalability (H=0.35-0.47). Systematic item deletions and rescaling found that an 7-item scale is more efficient and with information (discrimination) ranging from 1.56 to 2.57 and stronger range of scalability (H=0.47-0.52). A 3-item scale is highly discriminatory but offers a narrow range of person ability (difficulty). A logistic regression differential item function (DIF) analysis exposed significant gender item bias functioning uniformly across all versions of the scale.ConclusionsAcross 401,648 UK Biobank participants, the 12-item EPQ-R neuroticism scale exhibited psychometric inefficiency with poor discrimination at the extremes of the scale-range. High and low scores are relatively poorly represented and uninformative suggesting that high neuroticism scores derived from the EPQ-R are a function of cumulative mid-range values. The scale also shows evidence of gender item bias and future scale development should consider the former along with item deletions.

Sign in / Sign up

Export Citation Format

Share Document