scholarly journals Construction and validation of an instrument to assess the reading comprehension of students from the third to the fifth grades of elementary school

CoDAS ◽  
2014 ◽  
Vol 26 (1) ◽  
pp. 28-37 ◽  
Author(s):  
Vera Lúcia Orlandi Cunha ◽  
Simone Aparecida Capellini

Purpose: In this study, we aimed at building and validating an instrument to assess reading comprehension, with the purpose of characterizing the reading profile and detecting comprehension difficulties among students from the third to the fifth grades of elementary school. Methods: Participants were 378 students, divided into three groups. Their comprehension of micro- and macrostructural literal and inferential propositions that composed two expository texts and two narrative texts were assessed by means of multiple-choice questions. Results: The data analyzed statistically yielded Cronbach's alpha values showing internal consistency in the four texts applied to the three groups. Conclusion: It was possible to verify that the students had fewer errors as the school years progressed and that each type of text posed a particular difficulty to the students.

2017 ◽  
Vol 34 (3) ◽  
pp. 411-422
Author(s):  
Vera Lúcia Orlandi CUNHA ◽  
Simone Aparecida CAPELLINI

Abstract The objective of this study was to develop two intervention programs to promote reading comprehension, one for narrative texts and one for expository texts, to be used by 3rd-5th grade elementary school teachers in the classroom. The applicability of the programs was verified. A total of 143 elementary school students in 3rd, 4th, and 5th grades participated in this study. The students were evaluated before and after the administration of the intervention programs. There were significant differences in the answers of inferential questions about the macrostructure of the narrative texts in the three groups of students evaluated. A significant difference was also observed in the expository texts for the group of 5th graders, indicating superior performance of the students submitted to the programs. The strategies of the informative programs were more effective in improving students’ reading performance on the narrative texts than on the expository texts. Therefore, the strategies used should be reviewed in future studies.


2016 ◽  
Vol 16 (1) ◽  
pp. 1-14 ◽  
Author(s):  
Syed Haris Ali ◽  
Patrick A. Carr ◽  
Kenneth G. Ruit

Purpose Plausible distractors are important for accurate measurement of knowledge via multiple-choice questions (MCQs). This study demonstrates the impact of higher distractor functioning on validity and reliability of scores obtained on MCQs. Methods Free-response (FR) and MCQ versions of a neurohistology practice exam were given to four cohorts of Year 1 medical students. Consistently non-functioning multiple-choice distractors (<5% selection frequency) were replaced with those developed from incorrect responses on FR version of the items, followed by administration of the revised MCQ version to subsequent two cohorts. Validity was assessed by comparing an index of expected MCQ difficulty with an index of observed MCQ difficulty, while reliability was assessed via Cronbach’s alpha coefficient before and after replacement of consistently non-functioning distractors. Result Pre-intervention, effect size (Cohen’s d) of the difference between mean expected and observed MCQ difficulty indices was noted to be 0.4 – 0.59. Post-intervention, this difference reduced to 0.15 along with an increase in Cronbach’s alpha coefficient of scores obtained on MCQ version of the exam. Conclusion Multiple-choice distractors developed from incorrect responses on free-response version of the items enhance the validity and reliability of scores obtained on MCQs.


2021 ◽  
Vol In Press (In Press) ◽  
Author(s):  
Gona Bekry ◽  
Parvin Sarbakhsh ◽  
Hamid Allahverdipour ◽  
Abdolreza Shaghaghi

Background: Pediculosis is a common ectoparasitic infestation that involves especially the skin of children worldwide. Studying the children’s perception of the disease’s risk factors, the effectiveness of personal preventive measures, and its implications for their health could be a major leap forward in health promotion activities. Objectives: This study aimed to develop and evaluate the psychometric properties of the Children’s Perception Scale of Head Lice Infestation (CPS-HLI) and its initial feasibility assessment for use on Iranian and possibly other elementary school children. Methods: The scale’s items were retained based on an extensive literature search and classified into the underlying constructs of the Extended Health Belief Model (EHBM). An expert panel endorsed the qualitative content and face validity of the preliminary draft, and 47 items remained for quantitative validity testing on a sample of 362 elementary school students in the city of Paveh, West of Iran. Explanatory and confirmatory factor analyses (EFA and CFA) were employed to test the content and structural validity of the constructed instrument. Cronbach's alpha and intra-class correlation coefficients were calculated to assess the internal consistency and reliability of the scale. Results: The values of Lawshe's content validity index (0.90) and content validity ratio (0.77), the subscales’ Cronbach's alpha (0.59), and intra-class correlation (0.72) coefficients confirmed plausible internal consistency of the scale. The values of root mean square error of approximation (RMSEA) (< 0.08 with χ2 < 0.05), Tucker-Lewis Index (TLI), and Comparative Fit Index (CFI) > 0.9 approved the applied statistical model’s goodness of fit. The ranges of Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy for the underlying subscales (0.49 - 0.74) and the statistically significant result of Bartlett’s test of sphericity (P < 0.001) confirmed the patterned relationship among the constructed scale’s items. The principal component analysis that was performed using STATA favored the 11-factor solution. Conclusions: The study findings support the construct validity of CPS-HLI for use in studies on children’s perception of head lice infestation risk factors, the effectiveness of personal preventive measures, and the disease implications for their health and well-being. Further cross-cultural and cross-national validation studies are recommended for using the instrument in a wider range of populations and settings.


2020 ◽  
Vol 8 (1) ◽  
Author(s):  
Melis Orhan ◽  
Nicole Korten ◽  
Ralph Kupka ◽  
Patricia van Oppen ◽  
Max Stek ◽  
...  

Abstract Background Many frequently used instruments fail to assess psychosocial functioning in patients with bipolar disorder. The Functioning Assessment Short Test (FAST) was developed in order to tackle this problem and to assess the main functioning problems experienced by patients with bipolar disorder. However, the original FAST is not fully applicable in older adults due to the domain of occupational functioning. The aim of our study was to validate an adapted version for Older adults (FAST-O) in a group of older adults with bipolar disorder (OABD). Methods 88 patients aged 50 years and over diagnosed with bipolar disorder were included. We adapted the items in the area of “work-related functioning” of the FAST into items assessing “societal functioning”. Several measurements were conducted in order to analyse the psychometric qualities of the FAST-O (confirmatory factor analysis for internal structure, Cronbach’s alpha for internal consistency, Spearman’s rho for concurrent validity, Mann–Whitney U test for discriminant validity). Results Mean age in the study sample was 65.3 (SD = 7.5) and 57.3% was female. The internal structure was most similar to the internal structure of the original FAST. The internal consistency was excellent (Cronbach’s alpha = .93). The concurrent validity when correlated with the Social and Occupational Functioning Assessment Scale was low, but significant. The FAST-O was also able to distinguish between euthymic and symptomatic OABD patients. Conclusions The FAST-O has strong psychometric qualities. Based on our results, we can conclude that the FAST-O is a short, efficient solution in order to replace global rating scales or extensive test batteries in order to assess daily functioning of older psychiatric patients in a valid and reliable manner.


2021 ◽  
Vol 9 (1) ◽  
Author(s):  
Rebecca Horn ◽  
Kanykey Jailobaeva ◽  
Stella Arakelyan ◽  
Alastair Ager

Abstract Background Studies of psychological distress in Sierra Leone have typically used measures which were developed for use in other contexts, and which often have not been adapted or validated for use in Sierra Leone. This has resulted in a lack of reliable information about the patterns of psychological distress within the population, which is a barrier to the development of effective and appropriate mental health services. The aim of the study was to develop a locally-appropriate measure of psychological distress for Sierra Leone. Methods The new measure consists of two instruments: the Sierra Leone Psychological Distress Scale (SLPDS) and a gendered measure of ability to carry out daily tasks—a Function scale—as an indication of the severity of distress. A three-phase mixed methods exploratory sequential study was conducted. Phase 1 was item generation and testing, leading to the development of a set of potential items for both instruments. Phase 2 was a small pilot study (N = 202) leading to the selection of the final set of items for both measures. Phase 3 was a validation phase where the SLPDS and the Function scale were administered with a larger sample of 904 respondents. Item analysis was used to assess the internal consistency of the scales, and Exploratory Factor Analysis to explore the properties of the SLPDS. Results Exploratory factor analysis using the principal axis factoring with an oblique rotation identified a three-factor structure for the 18-item SLPDS. Internal consistency for the SLPDS (Cronbach’s alpha = 0.89) and three subscales was good (Cronbach’s alpha > 0.73). The internal reliability of the male and female versions of the Function scale was also found to be acceptable (Cronbach’s alpha = 0.90 for the female scale and 0.79 for the male scale). Conclusions Together the SLPD and Function scales provide a locally-validated tool which will enable government bodies and local and international non-governmental organisations in Sierra Leone to assess mental health and psychosocial needs. This will support both effective service provision and the evaluation of initiatives designed to improve mental health and psychosocial wellbeing.


2021 ◽  
Vol 10 (10) ◽  
pp. 2081
Author(s):  
Edyta Kinel ◽  
Krzysztof Korbel ◽  
Piotr Janusz ◽  
Mateusz Kozinoga ◽  
Dariusz Czaprowski ◽  
...  

The study aimed to carry on the process of the cultural adaptation of the Italian Spine Youth Quality of Life Questionnaire (ISYQOL) into Polish (ISYQOL-PL). The a priori hypothesis was: the ISYQOL-PL questionnaire is reliable and appropriate for adolescents with a spinal deformity. Fifty-six adolescents (mean age 13.8 ± 1.9) with idiopathic scoliosis (AIS) with a mean Cobb angle 29.1 (±9.7) and two with Scheuermann juvenile kyphosis (SJK) with a kyphosis angle 67.5 (±17.7) degrees were enrolled. All patients had been wearing a corrective TLSO brace for an average duration of 2.3 (±1.8) years. The Institutional Review Board approved the study. The cross-cultural adaptation of the ISYQOL-PL was performed following the guidelines set up by the International Quality of Life Assessment Project. The reliability was assessed using internal consistency (the Cronbach’s alpha coefficient) and test–retest reliability (intraclass correlation coefficient ICC2.1, CI = 95%); moreover, floor and ceiling effects were calculated. The internal consistency was satisfactory (Cronbach’s alpha coefficient 0.8). The test–retest revealed high reliability with the value of ICC2.1 for the entire group 0.90, CI (0.84 to 0.94). There was neither floor nor ceiling effect for the ISYQOL-PL overall score. The ISYQOL-PL is reliable and can be used in adolescents with spinal deformity.


2016 ◽  
Vol 65 (3) ◽  
pp. 201-208 ◽  
Author(s):  
Eliane Traebert ◽  
Karoliny dos Santos ◽  
Luciana Müller Carvalho ◽  
Jane da Silva ◽  
Jefferson Traebert

ABSTRACT Objective To carry out the preliminary stages of the cross-cultural adaptation of the Family Assessment Device (FAD) to Brazilian Portuguese language and examine its reliability. Methods The translation and cross-cultural adaptation of the FAD were developed according to the methods internationally recommended. The resulting product was applied to 80 individuals who completed the questionnaire on two different occasions, seven days apart. Internal consistency was obtained through Cronbach’s alpha, and reliability was estimated by using the Bland and Altman method. Results The internal consistency obtained was very good (Cronbach’s alpha = 0.910). The mean differences of FAD dimensions found in the Bland and Altman test were the following: -0.21 (Problem Solving); -0.32 (Communication); -0.17 (Roles); 0.2 (Affective Responsiveness); -0.27 (Affective Involvement); -0.08 (Behavior Control); -0.02 (General Functioning). Conclusion The processes of translation and cross-cultural adaptation were successful. Assessment of the structural validity and external construct validity is recommended for the improvement of the Brazilian version.


2014 ◽  
Vol 48 (1) ◽  
pp. 25-33 ◽  
Author(s):  
Noélle de Oliveira Freitas ◽  
Marina Paes Caltran ◽  
Rosana Aparecida Spadoti Dantas ◽  
Lidia Aparecida Rossi

This methodological study aimed to describe the process of translation and cultural adaptation of the Perceived stigmatization Questionnaire (PSQ) and analyze the internal consistency of the items in the step of pre-testing. The PSQ was developed to evaluate the perception of stigmatizing behaviors of burn victims. The adaptation process was carried out from August 2012 to February 2013, comprising the steps outlined in the literature. As part of this process, the pre-test with 30 adult burn victims was held. All participants at this step reported to understand the instrument items and the scale of responses. There were no suggestions or changes in the tested version. The value of Cronbach’s alpha at pre-test was 0.87. The contribution of this study is to describe the operation of each of the steps of this methodological process and show the internal consistency of the items in the pre-test.


2018 ◽  
Vol 43 (1) ◽  
pp. 80-87 ◽  
Author(s):  
Robert Gailey ◽  
Anat Kristal ◽  
Jennifer Lucarevic ◽  
Shane Harris ◽  
Brooks Applegate ◽  
...  

Background: Prosthetic socket fit is an important element associated with successful ambulation and use of a prosthesis. Prosthetists and rehabilitation clinicians would benefit from an assessment tool that discriminates between and quantifies the multiple determinants that influence the lower limb amputee’s performance and satisfaction of a prosthetic socket. Objectives: To determine the internal consistency of the comprehensive lower limb amputee socket survey, a new self-report measure of prosthetic socket satisfaction that quantifies suspension, stability, comfort, and appearance. Study design: Cross-sectional sample of active amputees. Methods: Interviews were conducted with prosthetists, physical therapists, and lower limb amputees to identify clinical concerns and common activities influencing socket fit. An expert panel of five clinicians reviewed the items and constructed the original version of the comprehensive lower limb amputee socket survey which was then administered to a convenience sample of 47 active lower limb amputees. Item analysis and Cronbach’s alpha were used to determine the final version of the comprehensive lower limb amputee socket survey. Results: Following item raw score-to-total score correlation with Cronbach’s alpha for comprehensive lower limb amputee socket survey determinants, internal consistency improved when nine questions were eliminated. Conclusion: The comprehensive lower limb amputee socket survey is a self-report measure of prosthetic socket satisfaction with very good internal consistency. Clinical relevance When socket problems occur, the ability to determine the specific cause can reduce modification time, enhance socket fit, and promote patient satisfaction. A standardized multi-dimensional assessment measure of socket satisfaction enables prosthetists to quantify the multiple determinants of socket satisfaction, improve patient communication, and demonstrate the value of socket interventions.


2017 ◽  
Vol 41 (S1) ◽  
pp. S255-S255
Author(s):  
B. Alansari ◽  
T. AlAli

IntroductionThe Oxford Happiness Inventory (OHI) 29-Item, each involving the selection of four options that are different for each item. Although there is an Arabic version, it is not identical to the original version in terms of the number of items and response.Objectivesto evaluate the psychometric properties of the Arabic adaptation OHI and its factorial structure in undergraduate sample.MethodsThe participants were 720 first year undergraduate Kuwaitis: 360 males mean age = 20.38 ± 1.60 and 360 females; mean age = 19.71 ± 1.39 (t = 5.87, P < 0.001). The Arabic version of OHI (Argyle, Martin, & Crossland) was administered to participants. The internal consistency reliability, factor structure, and convergent validity of the OHI with Life Orientation Test (LOT-R, Adult Hope Scale (AHS), Satisfaction With Life Scale (SWLS) were assessed as well as divergent validity of the OHI with Beck Depression Inventory-II (BDI-II)ResultsInternal consistency was satisfactory for the OHI (Cronbach's alpha = 0.87) for males and (Cronbach's alpha = 0.86) for females. The results revealed no significant gender differences on happiness (F = 1.77, P > 05). Principal component analyses (PCA) showed that a seven-component solution explains %50.50 of the total variance for males and 51.47% for females. The OHI positively correlates with the following variables: SWLS (r = .52), LOT-R (r = 0.56) AHS (r = .48) while the OHI correlates negatively with BDI-II (r = -54).ConclusionsFindings confirm that the OHI provides satisfactory validation, and thus it can be recommended as a measure of happiness among Arab samples.Disclosure of interestThe authors have not supplied their declaration of competing interest.


Sign in / Sign up

Export Citation Format

Share Document