scholarly journals Concurrent Validity and Reliability for the Communication Complexity Scale

2018 ◽  
Vol 27 (1) ◽  
pp. 237-246 ◽  
Author(s):  
Nancy C. Brady ◽  
Kandace Fleming ◽  
Rebecca Swinburne Romine ◽  
Alison Holbrook ◽  
Kristen Muller ◽  
...  

Purpose The Communication Complexity Scale (CCS; Brady et al., 2012) was created to fill a void in measures of expressive communication skills in individuals who communicate primarily with presymbolic or early symbolic means. CCS scores reflect expressive communication observed during interactive communication contexts. Method Two studies were completed to examine the reliability and validity of the revised CCS scores. Participants in both studies had minimal verbal skills (i.e., produced less than 20 functional words). Study 1 examined interobserver agreement, test–retest reliability, and concurrent validity for 239 participants with intellectual disabilities between the ages of 3–66 years, assessed with the protocol developed at the University of Kansas (KU CCS). CCS scores were compared with scores from the Vineland Adaptive Behavior Scales–Second Edition (Sparrow, Cicchetti, & Balla, 2005) and the Communication Matrix (Rowland & Fried-Oken, 2010). Study 2 examined the reliability and concurrent validity for CCS scores derived from 110 children (chronological age = 3–9) with autism from diverse backgrounds. These children were assessed with the Early Social Communication Scale (Mundy et al., 2003). CCS scores were compared with rates of communication derived from the Early Social Communication Scale. Results CCS scores were moderately correlated with scores from existing measures of early communication. In addition, CCS scores from different raters were reliable, and test–retest scores were highly similar. Conclusions These findings support the validity and reliability of the CCS when used with individuals across a wide range of ages and with various types of disabilities. The CCS can be used in research and clinical practice to describe extant communication levels in individuals with minimal verbal skills.

2020 ◽  
Vol 51 (4) ◽  
pp. 1139-1155
Author(s):  
Jenny M. Burton ◽  
Nancy A. Creaghead ◽  
Noah Silbert ◽  
Allison Breit-Smith ◽  
Amie W. Duncan ◽  
...  

Purpose The purpose of this study was to characterize social communication and structural language of school-age girls with high-functioning autism spectrum disorder (HF-ASD) compared to a matched group of girls who are typically developing (TD). Method Participants were 37 girls between 7;5 and 15;2 (years;months)—18 HF-ASD and 19 TD. Children completed the Test of Pragmatic Language–Second Edition (TOPL-2) and Clinical Evaluation of Language Fundamentals–Fifth Edition. Parents completed the Children's Communication Checklist–2 United States Edition (CCC-2) and Receptive and Expressive Communication subdomains of the Vineland Adaptive Behavior Scales–Second Edition. Results In the area of social communication, girls with HF-ASD earned significantly lower scores and were more often classified as having an impairment on the TOPL-2 and the CCC-2. However, 28% and 33% earned average scores on the TOPL-2 and the CCC-2, respectively. In the area of structural language, no significant differences were found between groups on Clinical Evaluation of Language Fundamentals–Fifth Edition indexes. In contrast, girls with HF-ASD earned significantly lower scores and were more often classified as having an impairment on the Vineland Adaptive Behavior Scales–Second Edition. Sixty-one percent and 83% scored below average on the Receptive and Expressive Communication subdomains, respectively. Conclusions It has been argued that girls with HF-ASD, when compared to boys with HF-ASD, may have advantages for social communication and structural language that mask their impairments. However, when compared to girls who are TD, girls with HF-ASD demonstrated impaired social communication and structural language. Clinicians should include and carefully examine multiple sources of information when assessing girls with HF-ASD.


Children ◽  
2020 ◽  
Vol 7 (10) ◽  
pp. 175 ◽  
Author(s):  
Santosh Kumar Tadakamadla ◽  
Garima Mangal ◽  
Mir Faeq Ali Quadri ◽  
Maryam Nayeem ◽  
Jyothi Tadakamadla

The current research aims to evaluate the reliability and validity of the Hindi Child Perception Questionnaire (CPQ11–14) in a child population of India. A randomly selected sample of children aged 11–14 years (n = 331) and their parents completed the Hindi translation of CPQ11–14 and the Parental-Caregiver Perceptions Questionnaire (P-CPQ), respectively, in this cross-sectional study. Children also provided a self-rating of oral health and were examined for dental caries. Exploratory Factor Analysis (EFA) was conducted to assess the dimensionality of the Hindi-CPQ11–14. Internal consistency and reliability on repeated administration were evaluated. Convergent and divergent validities were determined by estimating correlation coefficients between items and the hypothesised subscales. Concurrent validity was assessed using multiple linear regression analyses. The four factors extracted in EFA had a total variance of 38.5%, comprising 31 items. Cronbach’s alpha for the internal consistency of the overall scale was 0.90; reliability on repeated administration was 0.92. All the Hindi CPQ11–14 items had an item-hypothesised subscale correlation coefficient of ≥0.4, and these were greater than item-other hypothesised subscale correlations, demonstrating good convergent and divergent validities respectively. Hindi-CPQ11–14 was associated with self-ratings of the oral health and overall P-CPQ scores demonstrating good concurrent validity. Hindi-CPQ11–14 showed a factor structure different from the English CPQ11–14 and exhibited good validity and reliability.


2019 ◽  
Vol 11 (5) ◽  
pp. 409-415 ◽  
Author(s):  
Fábio Carlos Lucas de Oliveira ◽  
Anny Fredette ◽  
Sherezada Ochoa Echeverría ◽  
Charles Sebiyo Batcho ◽  
Jean-Sébastien Roy

Context: Two-dimensional (2D) video-based analysis is often used by clinicians to examine the foot strike pattern (FSP) and step rate in runners. Reliability and validity of 2D video-based analysis have been questioned. Objective: To synthesize the psychometric properties of 2D video-based analysis for assessing runners’ FSP and step rate while running. Data Sources: Medline/PubMed, Science Direct, Embase, EBSCOHost/CINAHL, and Scielo were searched from their inception to August 2018. Study Selection: Studies were included if (1) they were published in English, French, Portuguese or Spanish; (2) they reported at least 1 psychometric property (validity and/or reliability) of 2D video-based analysis to assess running kinematics; and (3) they assessed FSP or step rate during running. Study Design: Systematic review. Level of Evidence: Level 2. Data Extraction: Studies were screened for methodological (MacDermid checklist) and psychometric quality (COSMIN checklist) by 2 independent raters. Results: Eight studies, with a total of 702 participants, were included. Seven studies evaluated the reliability of 2D video to assess FSP and found very good to excellent reliability (0.41 ≤ κ ≤ 1.00). Two studies reported excellent reliability for the calculation of step rate (0.75 ≤ intraclass correlation coefficient [ICC] ≤ 1.00). One study demonstrated excellent concurrent validity between 2D and 3D (gold standard) motion capture systems to determine FSP (Gwet agreement coefficient [AC] > 0.90; ICC > 0.90), and another study found excellent concurrent validity between 2D video and another device to calculate step rate (0.84 ≤ ICC ≤ 0.95). Conclusion: Strong evidence suggests that 2D video-based analysis is a reliable method for assessing FSP and quantifying step rate, regardless of the experience of the assessor. Limited evidence exists on the validity of 2D video-based analysis in determining FSP and calculating step rate during running.


2017 ◽  
Vol 2017 ◽  
pp. 1-9
Author(s):  
Gila Tubul-Lavy ◽  
Nirit Lifshitz

Despite the consensus in the literature regarding the importance of organizational abilities in performing daily tasks, currently there is no assessment that focuses exclusively on such abilities among young children. The study aims to develop a Questionnaire for Assessing Preschoolers’ Organizational Abilities (QAPOA), Parents’ and Teachers’ versions, and to examine their reliability and validity. QAPOA was distributed to preschool teachers and parents of 215 typically developing 4–5.6-year-old children. The teachers’ and parents’ versions demonstrated good internal consistency. Factor analysis performed to examine the tool’s content validity yielded two factors: motor-based and language-based OA. Furthermore, both versions of the questionnaire demonstrated significant differences between OA among boys and girls. Concurrent validity was demonstrated between the QAPOA total scores and the equivalent subscale of the BRIEF-P. Given these findings, different cut-off scores were established for identifying boys and girls with either motor-based and/or language-based OA. The results indicate that both the teachers’ and parents’ versions of the QAPOA are reliable and valid measures of children’s organizational abilities. The questionnaires can assess and identify risk for organizational disabilities as early as preschool age. Thus, it can contribute to the planning of appropriate intervention programs and the prevention of difficulties in the future.


Author(s):  
Felipe García-Pinillos ◽  
Pedro A Latorre-Román ◽  
Jose M Chicano-Gutiérrez ◽  
Emilio J Ruiz-Malagón ◽  
Juan A Párraga-Montilla ◽  
...  

The biomechanics of walking and running, in both ground and treadmill conditions, have been extensively analysed and important differences have been reported. Despite some previous studies having examined the validity and reliability of the OptoGait™ system for measuring gait characteristics during walking, no previous works have determined the reliability and validity of this system while running on a treadmill. Therefore, this study aimed to determine the absolute reliability (within-subject variation) and evaluate the concurrent validity of the OptoGait™ system for measuring spatiotemporal variables while running at a comfortable speed by comparing data with a highly accurate system of measuring those parameters (i.e. video analysis at 1000 Hz). Forty-nine endurance runners performed a running protocol on a treadmill at a comfortable speed. Two systems were used to collect data: OptoGait™ system and high-speed video analysis at 1000 Hz. The coefficient of variation (CV) was calculated as a measure of absolute reliability. The OptoGait™ system reported a CV range between 2.2% and 11.4% for spatiotemporal parameters, while the video analysis showed a CV range between 0.02% and 9.9%. To determine concurrent validity, intra class correlation coefficients (ICC) and pairwise comparisons of means (t-test) were calculated between data from both systems. Although the paired t-test demonstrated significant differences between systems, a high level of agreement (ICC > 0.89) was obtained in spatiotemporal parameters between systems. When compared to a high-speed video analysis at 1000 Hz, the results indicate that the OptoGait™ system is a reliable and valid tool to measure spatiotemporal gait characteristics while running on a treadmill at a comfortable speed.


2016 ◽  
Vol 23 (3) ◽  
pp. 379-391 ◽  
Author(s):  
Suresh Mani ◽  
Shobha Sharma ◽  
Baharudin Omar ◽  
Aatit Paungmali ◽  
Leonard Joseph

Purpose The purpose of this review is to systematically explore and summarise the validity and reliability of telerehabilitation (TR)-based physiotherapy assessment for musculoskeletal disorders. Method A comprehensive systematic literature review was conducted using a number of electronic databases: PubMed, EMBASE, PsycINFO, Cochrane Library and CINAHL, published between January 2000 and May 2015. The studies examined the validity, inter- and intra-rater reliabilities of TR-based physiotherapy assessment for musculoskeletal conditions were included. Two independent reviewers used the Quality Appraisal Tool for studies of diagnostic Reliability (QAREL) and the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool to assess the methodological quality of reliability and validity studies respectively. Results A total of 898 hits were achieved, of which 11 articles based on inclusion criteria were reviewed. Nine studies explored the concurrent validity, inter- and intra-rater reliabilities, while two studies examined only the concurrent validity. Reviewed studies were moderate to good in methodological quality. The physiotherapy assessments such as pain, swelling, range of motion, muscle strength, balance, gait and functional assessment demonstrated good concurrent validity. However, the reported concurrent validity of lumbar spine posture, special orthopaedic tests, neurodynamic tests and scar assessments ranged from low to moderate. Conclusion TR-based physiotherapy assessment was technically feasible with overall good concurrent validity and excellent reliability, except for lumbar spine posture, orthopaedic special tests, neurodynamic testa and scar assessment.


2016 ◽  
Vol 10 (1) ◽  
pp. 67 ◽  
Author(s):  
Erdogan TEZCI

Teachers’ teaching approaches have become an important issue in the search of quality in education and teaching because of their effect on students’ learning. Improvements in teachers’ knowledge and awareness of their own teaching approaches enable them to adopt teaching process in accordance with their students’ learning styles. The Approaches to Teaching Inventory (ATI-R), which has been developed and revised in this framework, is a scale which is effectively used to define teaching approaches in different cultures. Originally written in English, the ATI-R’s validity and reliability results were very positive. The scale’s validity and reliability analyses in different languages and cultures have produced a wide range of different results. The aim of this paper is to adapt the scale in the Turkish language. Firstly, in order to handle linguistic equivalence, data collected from 40 teachers were analyzed, and then for confirmatory and reliability analyses data were collected from 485 teachers. According to the analyses, the scale has two dimensions, and under these two dimensions there are four sub-factors. Reliability and validity results in Turkish culture are also acceptable. As a result, the scale can be administered to define teachers’ teaching approaches in Turkish samples.


2019 ◽  
Vol 12 (2) ◽  
pp. 265-276
Author(s):  
James Athanasou

The purpose of this report is to evaluate the published version of the Visual Analog Mood Scales. These scales were published in 1997 and assess eight clinically relevant unipolar dimensions: afraid, confused, sad, angry, energetic, tired, happy, tense. From a search of the literature in PsycINFO, 24 empirical studies (including reliability and validity) were located on the application of the scales. The use of the scales for diagnosis, treatment and experimentation is described and published data on the test-retest reliability and validity of the scales is summarized. The reported test-retest correlations ranged from .43 to .87 and were considered too low for high stakes decisions. From nine studies, the concurrent validity coefficients across the eight scales ranged from a low of .12 to as high as .82. It is concluded that the scales have clinical utility for a quasi-non-verbal or pictorial assessment of mood states but there are limitations in the interpretation of the results. This is due to the shortcomings in the standardization samples as well as concerns for the psychometric quality in terms of validity and reliability.


BMJ Open ◽  
2022 ◽  
Vol 12 (1) ◽  
pp. e055922
Author(s):  
Hironori Yada ◽  
Ryo Odachi ◽  
Keiichiro Adachi ◽  
Hiroshi Abe ◽  
Fukiyo Yonemoto ◽  
...  

ObjectivesTo develop the Psychiatric Nurse Self-Efficacy Scales, and to examine their reliability and validity.DesignWe developed the Improved Self-Efficacy Scale (ISES) and Decreased Self-Efficacy Scale (DSES) using existing evidence. Statistical analysis was conducted on the data to test reliability and validity.SettingThe study’s setting was psychiatric facilities in three prefectures in Japan.ParticipantsData from 514 valid responses were extracted of the 786 responses by psychiatric nurses.Outcome measuresThe study measured the reliability and validity of the scales.ResultsThe ISES has two factors (‘Positive changes in the patient’ and ‘Prospect of continuing in psychiatric nursing’) and the DSES has three (‘Devaluation of own role as a psychiatric nurse’, ‘Decrease in nursing ability due to overload’ and ‘Difficulty in seeing any results in psychiatric nursing’). With regard to scale reliability, the Cronbach’s alpha coefficient was 0.634–0.845. With regard to scale validity, as the factorial validity of the ISES and DSES, for the ISES, χ2/df (110.625/37) ratio=2.990 (p<0.001), goodness-of-fit index (GFI)=0.962, adjusted GFI (AGFI)=0.932, comparative fit index (CFI)=0.967 and root mean square error of approximation (RMSEA)=0.062; for the DSES, χ2/df (101.982/37) ratio=2.756 (p<0.001), GFI=0.966, AGFI=0.940, CFI=0.943, RMSEA=0.059 and Akaike Information Criterion=159.982. The concurrent validity of the General Self-Efficacy Scale was r=0.149–0.446 (p<0.01) for ISES and r=−0.154 to −0.462 (p<0.01) for DSES, and the concurrent validity of the Stress Reaction Scale was r=−0.128 to 0.168 for ISES, r=0.214–0.398 for DSES (p<0.01).Statistical analyses showed the scales to be reliable and valid measures.ConclusionsThe ISES and DSES can accurately assess psychiatric nurses’ self-efficacy. Using these scales, it is possible to formulate programmes for improving psychiatric nurses’ feelings of self-efficacy.


Autism ◽  
2016 ◽  
Vol 21 (2) ◽  
pp. 203-216 ◽  
Author(s):  
Christine S Ghilain ◽  
Meaghan V Parlade ◽  
Matthew T McBee ◽  
Drew C Coman ◽  
Taylor Owen ◽  
...  

Joint attention, or the shared focus of attention between objects or events and a social partner, is a crucial milestone in the development of social communication and a notable area of deficit in children with autism spectrum disorder. While valid parent-report screening measures of social communication are available, the majority of these measures are designed to assess a wide range of behaviors. Targeted assessment of joint attention and related skills is primarily limited to semi-structured, examiner-led interactions, which are time-consuming and laborious to score. The Pictorial Infant Communication Scale is an efficient parent-report measure of joint attention that can be used as a complement to structured assessments in fully characterizing early social communication development. This study examined the psychometric properties of the Pictorial Infant Communication Scale. Results revealed a high degree of internal consistency and strong intercorrelations between subscales. Additionally, confirmatory factor analysis supported a three-factor model of joint attention. Furthermore, significant correlations between the Pictorial Infant Communication Scale and direct clinical measures of child joint attention, language skills, and autism spectrum disorder symptom severity were suggestive of concurrent validity. Findings suggest that the Pictorial Infant Communication Scale is a promising tool for measuring joint attention skills in preschool-aged children with autism spectrum disorder.


Sign in / Sign up

Export Citation Format

Share Document