“The Whole is More than the Sum of its Parts”: The Effects of Grouping and Randomizing Items on the Reliability and Validity of Questionnaires

1997 ◽  
Vol 13 (2) ◽  
pp. 67-74 ◽  
Author(s):  
Gabriele Helga Franke
Keyword(s):  
University Students ◽  
Group Testing ◽  
Reliability And Validity ◽  
Nursing School ◽  
Self Report ◽  
School Students ◽  
Application Study ◽  
Mean Values ◽  
The Mean ◽  
Item Presentation

This investigation was concerned with the widely spread practice to extract subscales from extensive psychodiagnostic inventories and to present their items in questionnaires as homogeneous item-blocks. By way of examining the effects of the mode of item-presentation on the reliability and validity, the frequently used and validated SCL-90-R was analyzed as a prototype of multidimensional symptom self-report inventories. Two studies were conducted in different contexts of application (study I: controlled group testing, study II: non-controlled individual testing) and involved different groups of subjects (study I: 130 nursing school students, study II: 134 university students). In both studies the standard item-arrangement was contrasted with the item-block presentation, which groups together items measuring the same dimension. The results revealed significant effects of item-blocking on the mean values, on the reliability, and the validity of the questionnaire. The findings seriously call into question the admissibility of subscale-extraction for self-report inventories. We conclude that the Gestalt paradigm, “The whole is more than the sum of its parts,” is valid for multidimensional psychodiagnostic inventories.

scholarly journals ASSESSING THE STUDENTS’ UNDERSTANDING RELATED TO MOLECULAR GEOMETRY USING A TWO-TIER DIAGNOSTIC TEST

2014 ◽  
Vol 13 (6) ◽  
pp. 839-855
Author(s):  
Melis Arzu Uyulgan ◽  
Nalan Akkuzu ◽  
Şenol Alpat
Keyword(s):  
University Students ◽  
Key Words ◽  
Diagnostic Test ◽  
Reliability And Validity ◽  
Molecular Geometry ◽  
Resonance Structure ◽  
The Subject ◽  
The Mean ◽  
Second Tier ◽  
Validity Tests

In this research, the comprehension levels and misconceptions of university students on the subject of molecular geometry were determined via a two-tier diagnostic test consisting of 25 items developed by researchers. It was applied on 110 university students. The reliability and validity tests and item analyses were conducted in relation to the test, and the difficulty and discrimination indices of the items were detected. The reliability coefficient of the test was found to be 0.856 while the mean difficulty value of the test was 0.487. According to the findings obtained from the second tier of the test containing open end questions, the students had a great deal of wrong information and numerous misconceptions in relation to the molecular geometry. Such statements as “atoms move in the resonance structure” and “bond angles of two molecules having a trigonal pyramidal shape cannot be different” are counted among the most important misconceptions determined in the study. Key words: Misconception, molecular geometry, two-tier diagnostic test, university students.

scholarly journals Near Points of Convergence and Accommodation in a Population of University Students in IranNear Points of Convergence and Accommodation in a Population of University Students in Iran

2019 ◽  
Author(s):  
Hassan Hashemi ◽  
Mojgan Pakbin ◽  
Babak Ali ◽  
Abbasali Yekta ◽  
Hadi Ostadimoghaddam ◽  
...  
Keyword(s):  
University Students ◽  
Adult Population ◽  
Age Groups ◽  
Multiple Linear Regression Model ◽  
Total Sample ◽  
Cluster Sampling ◽  
Young Student ◽  
Mean Values ◽  
Snellen Chart ◽  
The Mean

Purpose: To determine the distribution of the near point of convergence (NPC) and near point of accommodation (NPA) in a young student population in Iran. Methods: The subjects were selected using a cluster sampling method. All students underwent optometry tests, including visual acuity measurement, refraction, and cover test, as well as ophthalmic examinations. The NPC and NPA were measured using an accommodative target (near Snellen chart). Results: Of 1,595 students, the data of 1,357 were analyzed. The mean NPC and NPA in the total sample were 7.25 cm (95% confidence interval [CI], 7.02 to 7.48) and 9.99 cm (95% CI, 9.69 to 10.29), respectively. Older age was associated with an increase in the NPC, which increased from 6.98 cm in 18–20 years olds to 9.51 cm in those over 30 years. The NPA was significantly associated with age and refractive errors in the multiple linear regression model, increasing from 9.92 cm in 18–20 years olds to 11.44 cm in those over 30 years (P = 0.003). Hyperopic eyes had lower NPA than myopic and emmetropic eyes (P = 0.001). In younger age groups, the mean accommodation amplitude was lower than the mean Hofstetter value. Moreover, with age, especially after 30 years, the mean values surpassed those determined using the Hofstetter formula. Conclusion: The NPC values in this study were lower than those previously reported for identical age groups. The Hofstetter formula is not always an accurate predictor of the accommodation amplitude in the Iranian adult population.

Development of Proxy and Self-report Burn Model System Pediatric Itch Interference Scales: A National Institute on Disability, Independent Living, and Rehabilitation Research Burn Model System Study

2020 ◽  
Author(s):  
Dagmar Amtmann ◽  
Alyssa M Bamer ◽  
Kara McMullen ◽  
Karen Kowalske ◽  
Jeffrey C Schneider ◽  
...  
Keyword(s):  
Independent Living ◽  
Burn Injury ◽  
Reliability And Validity ◽  
Epidemiological Studies ◽  
Theory Model ◽  
Model System ◽  
Self Report ◽  
Proxy Report ◽  
Burn Survivors ◽  
The Mean

Abstract Pruritus is a commonly reported symptom after burn injury. Valid and reliable scales to measure itch in pediatric burn survivors are important for treatment and epidemiological studies. This study sought to develop psychometrically sound, publicly available self- and proxy-report measures of itch for use in pediatric burn survivors suitable for use in research and clinical practice. A panel of burn experts developed a definition of itch interference and a set of parallel self- and proxy-report candidate items that covered important activities affected by itch. Candidate items were evaluated in cognitive interviews with pediatric burn survivors (n = 4) and proxies (n = 2). Items were translated to Spanish and administered in both English and Spanish to a sample (N = 264) of pediatric burn survivors and/or their proxy enrolled in the Burn Model System (BMS) longitudinal database. The mean age of the pediatric sample was 13 years and average time since burn 5 years. The final itch interference measures each included 5 parallel items calibrated using a one-parameter graded response item response theory model, with a mean of 50 representing the average itch interference of the sample. Reliability of the scores is excellent between the mean and two standard deviations above. Initial analyses provide support for validity of the score. Concordance between the self- and proxy-report scores was moderate (ICC = 0.68). The results support the reliability and validity of the itch scale in children and youth with burn injury. The new BMS Pediatric Itch Interference scales are freely and publicly available at https://burndata.washington.edu/itch.

scholarly journals The Force-Velocity Relationship in Older People: Reliability and Validity of a Systematic Procedure

2017 ◽  
Vol 38 (14) ◽  
pp. 1097-1104 ◽  
Author(s):  
Julian Alcazar ◽  
Carlos Rodriguez-Lopez ◽  
Ignacio Ara ◽  
Ana Alfaro-Acha ◽  
Asier Mañas-Bote ◽  
...  
Keyword(s):  
Older Adults ◽  
Muscle Power ◽  
Reliability And Validity ◽  
Maximal Power ◽  
Mean Values ◽  
Multiple Loads ◽  
Velocity Relationship ◽  
Force Velocity ◽  
The Mean ◽  
Older Men And Women

AbstractThis study compared the reliability and validity of different protocols evaluating the force-velocity (F-V) relationship and muscle power in older adults. Thirty-one older men and women (75.8±4.7 years) underwent two F-V tests by collecting the mean and peak force and velocity data exerted against increasing loads until one repetition maximum (1RM) was achieved in the leg press exercise. Two attempts per load were performed, with a third attempt when F-V points deviated from the linear F-V regression equation. Then, the subjects performed 2×3 repetitions at 60% 1RM to compare purely concentric and eccentric-concentric repetitions. The Short Physical Performance Battery was conducted to assess the validity of the different protocols. Significant differences were found in maximal power (Pmax) between mean and peak values and between protocols differing in the number of attempts per load (p<0.01). Registering mean values, a third attempt, and multiple loads (>3), was significantly more reliable (Pmax: CV=2.6%; ICC=0.99) than the other alternatives. Mean values were also observed to be more associated with physical function than peak values (R2=0.34 and 0.15, respectively; p<0.05). No significant differences were observed between concentric and eccentric-concentric repetitions. Thus, collecting mean force and velocity values against multiple loads, while monitoring the linearity of the F-V relationship, seemed to be the more adequate procedure to assess the F-V profile and muscle power in older adults.

scholarly journals Prevalence and Levels of Forward Head Posture among School Going Children

2021 ◽  
Vol 5 (1) ◽  
pp. 022-025
Author(s):  
Hemendra Chandoliya ◽  
Varsha Chorsiya ◽  
Dhananjay Kaushik
Keyword(s):  
Cervical Spine ◽  
Early Stage ◽  
Research Work ◽  
Plumb Line ◽  
Early Screening ◽  
School Students ◽  
Forward Head Posture ◽  
Mean Values ◽  
Head Posture ◽  
The Mean

Introduction: Exposure of overloaded bag packs and early usage of digital gadgets amongst school going children alters the cervical spine posture. The present research work intends to study the prevalence of forward head posture in school going children. The study also elucidates the ranges to consider for mild, moderate and severe forward head posture prevalence. Methods: A total of 100 school students (50 males and 50 females) were recruited for cross-sectional study. Assessment of forward head posture was done using plumb line. The students were made to stand at a point marked 25 cm distance away from the plumb line. The researcher, from the side view, using a meter scale, measured the distance between the tragus of the ear and plumb line and record it. The weight of the school bag was measured using the weighing machine and the time for which gadgets were used was recorded as per the subject/parents feedback. Results: The mean values for age, height, weight and BMI are 13.67 ± 0.55 years, 158.56 ± 7.71 cms, 46.47 ± 10.50 kgs and 18.40 ± 3.48 kg /m2 respectively. The mean values for gadgets time use, distance plumb line and weight bag are 130.50 ± 67.07 min, 1.96 ± 1.19 cm and 4.32 ± 1.70 kgs respectively. About ~27% children having mild or no FHP (less than or equal to 1 cm), ~37% children having moderate FHP (ranging between 1.01 cm to 2.49 cm) and ~36% children found to have severe FHP (more than or equal to 2.5 cm). Conclusion: The study showed that the FHP is developing at early stage in the school going children and it has the potential of altering cervical spine biomechanics. Early screening is much essential aspect to prevent FHP. The ergonomic based awareness programs should be organized to sensitize children about the right posture and to indulge them in physical activity.

The Asthma Belief Survey: Development and Testing

2004 ◽  
Vol 12 (1) ◽  
pp. 7-19 ◽  
Author(s):  
Barbara Velsor-Friedrich ◽  
Therese D. Pigott ◽  
Brenda Srof ◽  
Robin Froman
Keyword(s):  
Self Efficacy ◽  
Reliability And Validity ◽  
Survey Development ◽  
Self Report ◽  
Health Maintenance ◽  
Asthma Knowledge ◽  
Significant Relationships ◽  
Single Scale ◽  
The Mean ◽  
Care Practices

Accurate evaluation of asthma self-efficacy is essential to the effective management of asthma. This article describes the development and testing of the Asthma Belief Survey (ABS). The instrument is a 15-item tool that uses a 5-point self-report scale to measure asthma self-efficacy in relation to daily asthma maintenance and an asthma crisis. This instrument was tested with a sample of 79 African American school children, who attended eight inner-city elementary schools. The mean age of the sample was 11.05 years with a range of 8 to 14 years. The majority of students had been diagnosed with asthma prior to the age of 5 years. The Asthma Belief Survey demonstrated good psychometric properties: good Cronbach’s α reliability coefficient (.83), coherence as a single scale measuring children’s self-efficacy in treating their own asthma, and significant relationships with scales of asthma knowledge (r= .51,p< .000) and asthma self-care practices (r= .52,p< .001). The Asthma Belief Survey has sound reliability and validity evidence to support its use to measure a child’s asthma self-management self-efficacy. The practitioner can use this instrument to assess a child’s self-efficacy in the areas of asthma health maintenance and avoidance of asthma episodes.

scholarly journals Anthropometric measurements and amounts of body fat and serum cholesterol in samples of three Nigerian populations

1975 ◽  
Vol 33 (2) ◽  
pp. 141-148 ◽  
Author(s):  
R. S. Watson ◽  
K. M. Etta
Keyword(s):  
Body Weight ◽  
University Students ◽  
Body Fat ◽  
Serum Cholesterol ◽  
Skinfold Thickness ◽  
Mean Values ◽  
Cholesterol Levels ◽  
The Mean ◽  
Male Subjects ◽  
Triceps Skinfold Thickness

1. Skinfold thicknesses, arm circumferences, heights, weights and serum cholesterol levels were determined in ninety-one university students, 207 soldiers and 102 out-patients, all male subjects. Some of these measurements were used to determine the amount of body fat, Quetelet's index and mid-arm muscle circumference2. Quetelet's indices and body-fat values obtained were similar to previously reported values for lean or moderately built males3. Serum cholesterol levels were generally low, with means ranging from 3·98 mmol/1 for 18- to 29-year-old students to 5·19 mmol/l for 40- to 69-year-old out-patients4. The mean values for triceps skinfold thickness, the amount of body fat and serum cholesterol levels for healthy adults obtained in this study are probably normal for northern Nigerian populations5. There was a significant correlation between the amount of body fat and values for triceps and subscapular skinfold thicknesses, Quetelet's index and body-weight for all adults. The correlation between muscle circumference and the amount of body fat was significant for all subjects except adult soldiers.

Evidence for the Technical Adequacy of the Risk Assessment and Distress Recovery: Examining Risks While Avoiding Profiling Youth With Mental Health Difficulties

2021 ◽  
pp. 073428292110091
Author(s):  
Justin D. Garwood ◽  
Nicholas A. Gage
Keyword(s):  
Mental Health ◽  
High School ◽  
Risk Assessment ◽  
High School Students ◽  
School Violence ◽  
Students With Disabilities ◽  
Reliability And Validity ◽  
The United States ◽  
Self Report ◽  
School Students

This study examined the psychometric properties of the Risk Assessment and Distress Recovery (RADR) Scale—a new self-report psychological screening tool for high school students that explores risk factors related to mental health characteristics of students who have engaged in school violence. The sample consisted of 1093 high school students from all four regions of the United States. A four-factor model consisting of coping skills, depression, suicidal ideation, and narcissism demonstrated good fit. Results of confirmatory factor analysis and measurement invariance, as well as internal consistency estimates, provide initial evidence for reliability and validity of the RADR. Exploratory analyses between the RADR and characteristics of past school shooters are also presented. Students with disabilities self-reported significantly greater risks for mental health concerns across all four constructs, with small (.15) to large (.80) effect sizes.

scholarly journals Spelling performance of public and private school students: A comparative study

2017 ◽  
Vol 34 (3) ◽  
pp. 399-410
Author(s):  
Maria Nobre SAMPAIO ◽  
Natália FUSCO ◽  
Ana Carla Leite ROMERO ◽  
Amanda Corrêa do AMARAL ◽  
Simone Aparecida CAPELLINI
Keyword(s):  
Private School ◽  
Grade Level ◽  
School Students ◽  
Public And Private ◽  
Mean Values ◽  
Public School Students ◽  
Spelling Performance ◽  
Spelling Test ◽  
Private And Public ◽  
The Mean

Abstract To characterize and compare the spelling performance of private and public students. Three hundred 1st-5th graders from public and private schools in the city of Marília, São Paulo, Brazil, were evaluated, totalizing 30 students from each grade, respectively. Collective and individual versions of the Pró-Ortografia test (a renowned Brazilian spelling test) were administered. There were significant inter-group differences indicating that private school students achieved higher performance. The mean values of correct answers of higher grade level students were statistically greater than those of the lower grade level students. The results indicated that the mean values of correct answers of all versions of the spelling test administered increased across grades for both private and public school students. However, the data evaluated showed that private school students attained higher spelling performance than public school students from the 2nd grade onwards.

scholarly journals Reliability and validity of ecological literacy scale for primary school students

2020 ◽  
Vol 30 (Supplement_5) ◽  
Author(s):  
E E Öcal ◽  
M F Önsüz
Keyword(s):  
Primary School ◽  
Energy Transport ◽  
Reliability And Validity ◽  
Ecological Literacy ◽  
Primary School Students ◽  
Cronbach’S Alpha ◽  
School Students ◽  
Cronbach's Alpha ◽  
Expert Opinions ◽  
The Mean

Abstract Background Ecological literacy aims to build up a framework of view that identifies the association with nature and enhances the improvement of new areas to produce sustainable lifestyles. Today, this concept has become one of the important requirements for a sustainable community. The aim of the study was to develop the Ecological Literacy Scale (ELS) to determine the ecological literacy of primary school students. Methods This methodological study carried out in 233 primary school 4th grade students in an eco-school in the 2019-2020 academic year. By using literature 91 questions was collected including water, energy, transport and air, biodiversity, purchasing and waste topics which were main issues of ecological footprint. After taking expert opinions, a scale that consists of 32 questions and scored as I agree:3, undecided:2, I disagree:1 and was created named ELS. In order to evaluate the reliability of the scale, item total score correlation and internal consistency (Cronbach's alpha) analyzes and exploratory factor analysis was used for construct validity. Results Of the 52.8% students were male and their age ranges from 8-11, the mean was 9.5±0.6. After the scale development study, the scale consisted of 19 items and unidimension. Scale items explain 27.37% of total variance and factor loadings ranged from 0.42-0.64. The Cronbach's alpha coefficient was 0.846 for the scale. In the last form of the scale, the score that can be taken from scale range 19-57. It was accepted that by increasing of the score, ecological literacy level was increased. The mean score of the students was 51.73 ± 5.39 and the median was 53.0. Conclusions Ecological literacy could be considered as high level for primary school students in eco-school. ELS was found to be a valid-reliable tool for assesing ecological literacy in primary school students. Key messages Ecological literacy is an issue that students should be informed from the primary school period. In the literature, ELS seems the first scale about ecological literacy for primary school students and needs to be tested in large groups of students.

Sign in / Sign up

Export Citation Format

Share Document