Addressing Reliability Estimates When the Population is Small: Can Social Cognition Help?

1993 ◽  
Vol 73 (2) ◽  
pp. 499-505 ◽  
Author(s):  
Scott W. Brown ◽  
Mary M. Brown
Keyword(s):  
Social Cognition ◽  
Communication Satisfaction ◽  
Systematic Desensitization ◽  
Internal Reliability ◽  
Satisfaction Scale ◽  
Measurement Framework ◽  
Hospital Intensive Care Unit ◽  
Reliability Estimates ◽  
Critical Feedback ◽  
Gathering Data

One of the issues facing researchers studying very select populations is how to obtain reliability estimates for their instruments. When the populations and resulting samples of studies are very small and select, gathering data for typical reliability estimates becomes very difficult. As a result, many researchers ignore the concern about reliability of their instrumentation and forge ahead collecting data. In response to this concern, Bandura's model of social cognition and Wolpe's model of systematic desensitization were combined and applied to a group of 90 undergraduates completing a Communication Satisfaction Scale designed to assess the attitudes of intubated patients in a hospital Intensive Care Unit. Stimuli (text, auditory and visual) were provided to sensitize the subjects to the intubation procedure and to enable the subjects to imagine what it is like to be an intubated patient. The subjects responded to 10 items focusing on the communication issues of intubated patients on a scale in Likert format. Internal reliability (Cronbach alpha) was 0.83 for the entire scale. The results are discussed within both a social cognition and a measurement framework. While the resulting reliabilities cannot be directly applied to the intubated sample, the procedure may provide critical feedback to researchers and instrument developers prior to the actual administration of the instrument in research.

Applying Social Cognition in Assessing Reliability with a Small Sample

1994 ◽  
Vol 75 (1) ◽  
pp. 236-238
Author(s):  
Scott W. Brown ◽  
Mary M. Brown
Keyword(s):  
Social Cognition ◽  
Small Sample ◽  
Reliability Estimate ◽  
Internal Reliability ◽  
Large Samples ◽  
Reliability Estimates

An issue for researchers studying special or selected populations is how to obtain reliability estimates on instruments. In our 1993 study assessing the attitudes of intubated patients using a social cognition technique, the internal reliability estimate was 0.83. This study replicated and extended this finding and included items requesting subjects to estimate their ability to imagine the simulated intubation process. For 130 undergraduates alpha was 0.83. Most subjects reported they were able to imagine the situation and respond to the items accordingly. These results confirm the reliability and may have implications for estimating reliability of other scales which cannot be easily tested on large samples. While present estimates cannot be generalized, the procedure may provide useful feedback to researchers.

Communication satisfaction and trust among Turkish adolescent siblings

2017 ◽  
Vol 45 (1) ◽  
pp. 143-153
Author(s):  
Müge Çelik Örücü ◽  
Sühendan Er
Keyword(s):  
High School Students ◽  
Family Relationships ◽  
Communication Satisfaction ◽  
Age Difference ◽  
School Students ◽  
Satisfaction Scale ◽  
Dyadic Trust ◽  
Gender And Age ◽  
The Impact ◽  
Trust Scale

The relationships that exist among brothers and sisters have been much less researched and observed than other kinds of family relationships. Thus, the impact of sibling dyads' gender and age difference on Turkish adolescents' communication satisfaction and trust was examined. The sample consisted of 272 (154 female, 118 male) Turkish high school students, all of whom were aged between 14 and 18 years and had 1 younger sibling. They were asked to complete the Sibling Communication Satisfaction Scale and the Dyadic Trust Scale. A significant gender difference was obtained for both trust and communication satisfaction, wherein females were more likely than males were to trust and be satisfied with their level of communication with their siblings, especially in the case of same-gender siblings. However, no significant result was found for age difference in terms of either trust or communication satisfaction.

scholarly journals Reliability and Validity of the Chinese Nine-Item Basic Psychological Need Satisfaction Scale Based on Self-Determination Theory With Older Adults

2021 ◽  
Vol 12 ◽  
Author(s):  
Yuting Yang ◽  
Miao Yao ◽  
Yongwei Yang ◽  
Qiong Ye ◽  
Ting Lin
Keyword(s):  
Older Adults ◽  
Item Analysis ◽  
Reliability And Validity ◽  
Self Determination Theory ◽  
Psychological Needs ◽  
Need Satisfaction ◽  
Self Determination ◽  
Internal Reliability ◽  
Satisfaction Scale ◽  
Validity Criterion

Background: Self-determination theory distinguishes three basic human psychological needs: competence, relatedness, and autonomy. The measurement of these needs in populations of older adults has been limited and inadequate. Yet, results from such an assessment are likely to be valuable in policymaking, specifically toward the goal of healthy aging.Aim: The objective of this study was to test the reliability and validity of the Chinese version of the Basic Psychological Need Satisfaction Scale (BPNS) based on self-determination theory with older adults.Methods: A total of 809 older adults were invited to participate in this study. We examined the item analysis, internal reliability, factorial validity, criterion validity, and measurement invariance across sex of a Chinese translation of the BPNS.Results: The findings demonstrated that the scale had a good factorial validity, criterion validity, and satisfactory internal reliability. All the items were qualified according to item analysis (p < 0.001). The Cronbach’s α coefficient for the total scale was 0.877. The coefficients of three subscales were 0.826 (autonomy), 0.807 (competence), and 0.847 (relatedness). Exploratory factor analysis indicated three factors that explained 75.12% of the total variance. Confirmatory factor analysis showed measurement fit exceeded the recommended criteria in all the cases. Measurement invariance analysis manifested that the factor loadings, factor variances and covariances, and residuals to measurement structure were invariant across the male and female participants.Conclusion: The Chinese version of the BPNS based on self-determination theory was proven to be reliable and valid. The usability of the scale to assess the satisfaction of the basic psychological needs of older adults in China was demonstrated.

Development and Validation of the Couple Communication Satisfaction Scale

2018 ◽  
Vol 46 (5) ◽  
pp. 505-524
Author(s):  
Adam C. Jones ◽  
Rebecca Lucero Jones ◽  
Neli Morris
Keyword(s):  
Communication Satisfaction ◽  
Satisfaction Scale ◽  
Couple Communication ◽  
Development And Validation

Job Satisfaction Scale: Adaptation and Validation Among Indian IT (Information Technology) Employees

2017 ◽  
Vol 18 (3) ◽  
pp. 703-718
Author(s):  
Praveen Kumar Sharma ◽  
Rajnish Kumar Misra ◽  
Prachee Mishra
Keyword(s):  
Job Satisfaction ◽  
Information Technology ◽  
Factor Analysis ◽  
Exploratory Factor Analysis ◽  
Discriminant Validity ◽  
Satisfaction Scale ◽  
Minnesota Satisfaction Questionnaire ◽  
Convergent And Discriminant Validity ◽  
Reliability Estimates ◽  
Initial Scale

Job satisfaction (JS) of employees has been studied in the past by various researchers beginning in the 1930s till date. Each of these research works went on to add a perspective to JS and its measurement. The measures of JS captured various dimensions from Minnesota satisfaction questionnaire to JS survey. Further, these measures have been standardized on working professionals in various domains except the emerging field of information technology (IT). The purpose of this study was to develop and adapt a scale measuring JS of IT employees in India. The facets of JS were identified through literature and verified through experts in IT domain. The initial scale consisting of 23 items identified from the existing scales was administered on 410 employees of three IT companies in India. The scale was standardized through exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). It was used to determine the factor structure and convergent and discriminant validity. Exploratory factor analysis yielded six factors: pay, training, promotion, recognition, supervision and job security. A final standardized questionnaire consists of 23 items on JS. The reliability estimates were 0.92, and convergent and discriminant validity also met all the criteria respectively. The resultant scale can be used on IT professionals in India.

Reported Affectionate Communication and Satisfaction in Marital and Dating Relationships

2004 ◽  
Vol 95 (3_suppl) ◽  
pp. 1154-1160 ◽  
Author(s):  
Narissra Maria Punyanunt-Carter
Keyword(s):  
Relationship Satisfaction ◽  
Interpersonal Communication ◽  
Communication Satisfaction ◽  
Dating Relationships ◽  
Satisfaction Scale ◽  
Index Analysis ◽  
Significant Difference ◽  
The Relationship

This study analyzed affectionate communication and satisfaction in marital and dating relationships. 100 married and dating partners completed the Relationship Satisfaction Scale, the Interpersonal Communication Satisfaction Inventory, and the Affectionate Communication Index. Analysis indicated both married and dating partners were satisfied with their relationships; however, individuals in dating relationships reported higher Nonverbal and Verbal Affectionate Communication than individuals in married relationships. Moreover, there was a significant difference between married and dating partners on Supportive Affectionate Communication. Married partners were more likely to express supportiveness than dating partners.

scholarly journals Development of the Online Assessment of Athletic Training Education (OAATE) Instrument

2009 ◽  
Vol 4 (2) ◽  
pp. 66-69
Author(s):  
W. David Carr ◽  
Bruce B. Frey ◽  
Elizabeth Swann
Keyword(s):  
Athletic Training ◽  
Athletic Training Education ◽  
Discrimination Index ◽  
Online Assessment ◽  
Validity And Reliability ◽  
Internal Reliability ◽  
Reliability Estimates ◽  
Single Scale ◽  
Individual Domain ◽  
The Creation

Objective: To establish the validity and reliability of an online assessment instrument's items developed to track educational outcomes over time. Design and Setting: A descriptive study of the validation arguments and reliability testing of the assessment items. The instrument is available to graduating students enrolled in entry-level Athletic Training Education Programs (ATEPs). Methods: Validity was established with the creation of a national advisory board of Athletic Training educators. Construct validity was established with the creation of a test blueprint to guide the development of items for the knowledge exam. Internal reliability estimates for each domain were calculated. A single scale reliability analysis was conducted using all items. An item analysis was conducted by calculating difficulty and discrimination indexes for each item. Results: The internal reliability estimates ranged from .23 to .44 suggesting that individual domain scores for this draft of the instrument were not reliable. The single scale total score reliability however, produced an alpha = .84 suggesting a high level of reliability. Difficulty index scores ranged from .03 to .99 (mean = .74 ± .25). Discrimination index scores ranged from −.01 to .41 (mean = .21 ± .09). Conclusions: While the individual domain reliability was low, the overall single scale score is acceptable. Difficulty and discrimination index scores allowed the removal and revision of items to increase the overall reliability of the test bank.

Sign in / Sign up

Export Citation Format

Share Document