scholarly journals Validitas dan Reliabilitas Ujian SOCA (Students Oral Case Analysis): Studi di Salah Satu Fakultas Kedokteran di Indonesia

2016 ◽  
Vol 5 (3) ◽  
pp. 148
Author(s):  
Rizka Aries Putranti ◽  
Ova Emilia ◽  
Efrayim Suryadi
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Cognitive Complexity ◽  
Case Analysis ◽  
Medical Faculty ◽  
Validity And Reliability ◽  
Rater Reliability ◽  
Significant Difference ◽  
Kappa Value

Background: Medical faculty has to make sure that the students meet the minimal competence needed using apropriate exam. While the exam itself should facilitate students to learn. Oral examination has known for its ability to facilitate students learn but low in validity and reliability. Medical faculty of Lampung University (FK Unila) apply the student oral case analysis (SOCA) exam as one of block assessment component, as with MCQ, tutorial, and laboratory exam. This study aimed to evaluate validity and reliability of SOCA examination at FK UnilaMethod: Video of 65 students doing SOCA examination and 28 question rubrics had taken when odd semester exam year 2014-2015 has been carying out at FK Unila. Video and question rubrics were assessed by 5 panelis and analysed using Lawshe's content validity ratio (CVR) to determinate its content validity. Students performance on the video were re-assessed by another assessor to see inter-rater reliability, than analysed using kappa Cohen. Two expert in medical education assessed the cognitive comlpexity of the question rubrics. Data of SOCA's student's mark from year II, III, and IV were analysed for construct valdity and internal consistency.Results: 93,7% of the overall question in 65 video were valid (CVR>99%) and 71,8% question number in 28 question rubrics also valid according to 5 panelis. SOCA cognitive complexity were at level of analyse, know how and 4a. Inter-rater reliability analysis showed 0,549 (moderate agreement) kappa value. Mann Whitney analysis for construct validity showed no significant difference of all year. Cronbach alpha analysis showed internal consistency at the point 0,575.Conclusion: FK Unila's SOCA of odd semester examination year 2014-2015 has sufficient content validity, sufficient cognitive complexity and sufficent inter-rater reliability but lack in construct validity and internal consistency. Keywords: SOCA, validity, reliability

Covid-19 Literacy Scale: Turkish Validity and Reliability Study

2021 ◽  
pp. 105477382110598
Author(s):  
Ganime Can Gür ◽  
Yasemin Altinbaş
Keyword(s):  
Construct Validity ◽  
Factor Structure ◽  
Internal Consistency ◽  
Content Validity ◽  
Model Data ◽  
Validity And Reliability ◽  
Turkish Version ◽  
Reliability Study ◽  
Reliability Method ◽  
Test Retest Reliability

The current study was planned to test the validity and reliability of the Turkish version of the COVID-19 Literacy Scale. The sample of the study was taken from 473 individuals. In this study, language validity, content validity and construct validity were examined to determine the validity of the scale. Its reliability was evaluated by internal consistency, split-half reliability, and test-retest reliability method. It was defined that the scale has a two-factor structure as a result of EFA and its factor loadings are in the appropriate range (0.852–0.324). According to the CFA result, it was determined that the model-data fit was at a good level. The Cronbach values for the whole scale and subscales were .92, .90, and .87, respectively. It was observed that the test-retest value was .95. It was concluded that the Turkish form of the COVID-19 Literacy Scale is a reliable and valid tool.

scholarly journals Validity and Reliability of the Scale, Role Taking in Caregivers of People with Chronic Disease, ROL

10.3823/2575 ◽  
2018 ◽  
Vol 11 ◽  
Author(s):  
Mauricio Arias ◽  
Sonia Carreño ◽  
Lorena Chaparro
Keyword(s):  
Factor Analysis ◽  
Chronic Disease ◽  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Three Dimensions ◽  
Face Validity ◽  
Validity And Reliability ◽  
Role Taking ◽  
Phase Study

Objective: To determine face, content, and construct validity, and internal consistency of ROL scale. Methods and Findings: A three-phase study was conducted. First, content analysis of the scale was carried out consulting 10 professional experts. Then, face validity was analyzed with 60 caregivers. Finally, construct validity was evaluated by performing an exploratory factor analysis (EFA) with 110 participants. Internal consistency of ROL scale was also assessed. Face validity of ROL scale reached a high acceptance index in three dimensions: role performance (0.97), role organization (0.98), and response to the role (0.98). Content validity showed coherence, clarity, and relevance of the scale. From factor analysis, three components emerged and were grouped in the same manner for varimax, quartimax, and equimax rotations. Cronbach's alpha was 0.816, which is an acceptable overall value. Conclusion: ROL scale makes objective the concept of role taking in family caregivers of people with chronic disease. It demonstrated to have acceptable reliability, and construct, face, and content validity to be used in the Colombian context. Keywords: Validation Study, Caregivers, Health Transitions, Chronic Disease.

scholarly journals Measuring advance care planning behavior in Dutch adults: translation, cultural adaptation and validation of the Advance Care Planning Engagement Survey

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Doris van der Smissen ◽  
Agnes van der Heide ◽  
Rebecca L. Sudore ◽  
Judith A. C. Rietjens ◽  
Ida J. Korfage
Keyword(s):  
Chronic Disease ◽  
Construct Validity ◽  
Internal Consistency ◽  
Advance Care Planning ◽  
Content Validity ◽  
Intraclass Correlation ◽  
Criterion Validity ◽  
Care Planning ◽  
Validity And Reliability ◽  
Advance Care

Abstract Background Advance care planning (ACP) enables people to define, discuss, and record preferences for treatment and care. Measures of ACP behavior are lacking in the Netherlands. We aimed to translate, culturally adapt and validate the 34-item ACP Engagement Survey into Dutch. Methods Following validation guidelines, we tested content validity, internal consistency, reproducibility, construct validity, interpretability and criterion validity among persons with and without chronic disease. Results Forward-backward translation indicated the need of only minor adaptations. Two hundred thirty-two persons completed baseline and retest surveys; 121 were aged ≥60 years. Persons with chronic disease (n = 151) considered the survey more valuable than those without (66 vs. 59, p < 0.001, scale of 20–100), indicating good content validity. Internal consistency (Cronbach’s alpha: 0.97) and reproducibility (intraclass correlation: 0.88) were good. Total ACP Engagement was higher among persons with chronic disease than those without (2.9 vs. 2.4, p < 0.01, scale of 1 to 5), indicating good psychometric support for construct validity and interpretability. Positive correlations of the ACP Engagement Survey and the General Self-Efficacy survey indicated good criterion validity (p < 0.05). Conclusions This study provided good psychometric support for the validity and reliability of the Dutch 34-item ACP Engagement Survey. This instrument can be used to assess involvement in ACP in adults with and without chronic disease.

scholarly journals Validity and Reliability Assessment Tool of Nursing Students Professional Behavior

Jurnal NERS ◽  
2015 ◽  
Vol 10 (2) ◽  
pp. 208
Author(s):  
Fatikhu Yatuni Asmara
Keyword(s):  
Nursing Students ◽  
Construct Validity ◽  
Content Validity ◽  
Assessment Tool ◽  
Reliability Assessment ◽  
Reliability Test ◽  
Validity And Reliability ◽  
Professional Behaviour ◽  
Rater Reliability ◽  
Validity Test

Introduction: Shieffield Peer Review Assessment (SPRAT) is an instrument to assess medical student’s performance using Multi Source Feedback (MSF) method. The previous study stated that MSF with SPRAT is an effective tool assessing professional behaviour (PB) of nursing students both in clinical setting and community setting. However it needs more items to be added. Based on that explanation, it needs conducting validity and reliability test to make sure that the tool is valid and reliable. Method: There were two types of validity test used, content validity test and construct validity test as well as reliability test, namely inter-rater reliability test and item covariance test. Participants were four clinical instructors and 116 nursing students. Result: Content validity test showed that two items must be added as part of assessment item, namely diciplines and faithness. Furthermore construct validity test showed that five items were not valid since they had pearson correlation score <0.3. However the items were included as consideration of nursing students’s PB. Inter-rater reliability test and item covariance reliability test showed that the tool was reliable with score 0.460 and 0.912 respectively. Discussion: The assessment tool can be applied to assess PB of nursing students since it valid and reliable. It needs to investigate the effectiveness of the tool in difference of PB of nursing students.Keywords: validity, reliability, assessment tool of PB (professional behaviour)

scholarly journals Cross-Cultural Adaptation, Validity, and Reliability of the Patient-Rated Michigan Hand Outcomes Questionnaire for Thai Patients

2018 ◽  
Vol 2018 ◽  
pp. 1-6 ◽  
Author(s):  
Jananya P. Dhippayom ◽  
Piyawat Trevittaya ◽  
Andy S. K. Cheng
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Cultural Adaptation ◽  
Content Validity ◽  
Cross Cultural ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
Cross Cultural Adaptation ◽  
Limb Injuries ◽  
Test Retest Reliability

Introduction. The Michigan Hand Outcomes Questionnaire (MHQ) is a patient-rated hand outcome instrument. It is widely used in orthopedic and neurological conditions of the hands and upper limbs. To gain more knowledge on hand outcomes from a Thai patient perspective, an MHQ-Thai version is required. Purpose of the Study. The study is aimed at translating and cross-culturally adapting the MHQ into Thai and at examining the validity and reliability of the translated version. Methods. The Beaton protocol for cross-cultural adaptation of self-reported measures was used in the translation process. Three occupational therapists were asked to assess content validity while 30 participants were asked to fill in the questionnaire in order to assess construct validity, internal consistency, and test-retest reliability. Results. All six domains of the MHQ were translated into Thai without any major problems. However, items related to the characteristics of the patients were adapted to suit the Thai context. The MHQ-Thai version had good content validity (IOC 0.972). The construct validity revealed a low-to-high correlation between every subscale of the MHQ-Thai version. The intraclass correlation coefficient (ICC) of the test-retest reliability for the six domains ranged from 0.788 to 0.956, with excellent correlation (ICC = 0.953) for the total score. Cronbach’s alpha was 0.835 for the total score of the MHQ-Thai version, indicating good internal consistency. Discussion and Conclusions. MHQ was successfully cross-culturally adapted into Thai. The MHQ-Thai version is a valid and reliable instrument for evaluating the self-perception of Thai people who have hand and upper limb injuries.

scholarly journals Urdu Version of Oswestry Disability Index; A Reliability and Validity Study

2020 ◽  
Author(s):  
Fareeha Amjad ◽  
Mohammad Ali Mohseni Bandpei ◽  
Syed Amir Gilani ◽  
Ashfaq Ahmad ◽  
Muhammad Waqas ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Internal Consistency ◽  
Content Validity ◽  
Oswestry Disability Index ◽  
Convergent Validity ◽  
Moderate Correlation ◽  
Validity And Reliability ◽  
Discriminative Validity ◽  
Significant Difference ◽  
Smallest Detectable Change

Abstract Background:Although Oswestry Disability Index (ODI) is broadly used in clinical and research settings for assessing the disability level in patients with lumbar radiculopathy but it has not been translated into Urdu language according to the pre-established translation guidelines as well as the validity and reliability of ODI Urdu version has not been tested yet. The aim of this study was to translate ODI in native Urdu language (ODI-U) according to recommended guidelines and to measure its psychometric properties in Urdu speaking patients suffering from lumber radiculopathy. Methods: The ODI-U was developed through previously described translation procedures. 108 participants were recruited, out of which 54 were healthy and 54 were patients of lumber radiculopathy. ODI-U was filled by all participants. However, the patients were administered through ODI-U and visual analogue scales for disability (VAS disability) and pain intensity (VAS pain) at baseline and after 3 days. Reliability was investigated through test-retest method, internal consistency, standard error of measurement (SEM) and smallest detectable change (SDC) at 95% confidence level. ODI-U was assessed for exploratory factor analysis, construct (convergent and discriminative) validity and content validity. Alpha level <0.05 was considered statistically significant and psychometric standards were evaluated contrary to priori hypothesis.Results: The culturally adapted ODI-U revealed excellent test-retest reliability for total score (ICC=0.95) and for all item (ICC=0.72-0.98). Cronbach’s alpha of 0.89 showed excellent internal consistency and a moderate correlation between ODI-U total score and each item was observed through spearman’s correlation coefficient (r=0.51 to 0.76). One factor structure was created for ODI-U explaining 52.5% variance. There was no floor and ceiling effect of total ODI-U score showing good content validity. The discriminative validity was assessed by independent sample t-test which indicated significant difference in ODI-U total score between healthy and patients (P<0.001). The convergent validity was evaluated through Pearson’s correlation showing moderate correlation between ODI-U and VAS pain (r=0.49) as well as VAS disability (r=0.51).Conclusion: ODI-U showed adequate psychometric properties. ODI-U was found to be a reliable and a valid tool to measure the level of disability in Urdu-speaking patients with lumber radiculopathy.

scholarly journals The Validity and Reliability Test of Modified Picture Vocabulary Test IV in 48-59 Months Old Children

1970 ◽  
Vol 2 (01) ◽  
pp. 65-76
Author(s):  
Sumarni ◽  
Amendi Nasution ◽  
Luh K Wahyuni ◽  
Trevino Pakasi
Keyword(s):  
Construct Validity ◽  
Correlation Coefficient ◽  
Internal Consistency ◽  
Standard Error ◽  
Internal Consistency Reliability ◽  
Vocabulary Test ◽  
Validity And Reliability ◽  
Rater Reliability ◽  
Standard Error Of Measurement ◽  
Error Of Measurement

Objectives: To investigate the validity and reliability of Modified Picture Vocabulary Test IV (PPVTIV) in 48-59 months old child. Methods 228 items in 19 sets of PPVT IV were translated in Indonesian language and revised according to Indonesian culture. One hundred and five 48-59 months old children were tested. The results wereanalyzed for its construct validity and reliability. The construct validity was valued by the correlation coefficient between the set score and the total score and the correlation coefficient between the itemscore and the set score. The reliability was valued by intra-class correlation coefficient, standard error of measurement (SEM) and Cronbach alpha.Results: The construct validity of Modified PPVT IV was good (r>0.256; α=0.01 n=100) and the reliability was high (internal consistency with Cronbach alpha= 0.938, inter-rater reliability= 0.957-0,985 and standard error of measurement (SEM) = 6.4).Conclusions: Modified PPVT IV was a valid instrument with satisfactory reliability. To increase the construct validity, there were 36 items that should be substituted.Key Words: Modified PPVT IV, construct validity, internal consistency reliability, inter-rater reliability, standard error of measurement Received in

scholarly journals The validity and reliability of the patient enablement instrument (PEI) after GP appointments in Finnish health care centres

2020 ◽  
Vol 4 (1) ◽  
Author(s):  
Elina Tolvanen ◽  
Tuomas H. Koskela ◽  
Mika Helminen ◽  
Elise Kosunen
Keyword(s):  
Health Care ◽  
Pilot Study ◽  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Questionnaire Study ◽  
Validity And Reliability ◽  
Health Care Centre ◽  
Patient Enablement ◽  
Patient Enablement Instrument

Abstract Background The aim of this study was to assess the validity and reliability of the Patient Enablement Instrument (PEI) in Finnish health care centre patients. A pilot study was conducted to assess the content validity of the PEI. A questionnaire study in three health care centres in Western Finland was performed in order to assess acceptability, construct validity, internal consistency, and measurement error of the instrument. A telephone interview 2 weeks after the appointment was performed to evaluate reproducibility. Results The pilot study with 17 participants indicated good content validity of the PEI. In the questionnaire study, altogether 483 with a completed PEI score were included in the analyses. Factor analysis and item-scale correlations suggested high structural validity. The internal consistency of the instrument was high (Cronbach’s α = 0.93). The PEI score diminished strongly over the two-week period. Conclusions The PEI has good content validity and acceptability, good construct validity, high internal consistency but low reproducibility. Thus, the PEI seems to be an applicable tool to measure patient enablement in Finnish primary health care.

scholarly journals PSYCHOMETRIC EVALUATION OF FILIPINO VERSION OF PATIENT SATISFACTION INSTRUMENT

2019 ◽  
Vol 5 (6) ◽  
pp. 251-256
Author(s):  
Gil P Soriano ◽  
Kathyrine A Calong Calong
Keyword(s):  
Patient Satisfaction ◽  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Psychometric Evaluation ◽  
Internal Consistency Reliability ◽  
Validity And Reliability ◽  
Validity Index ◽  
Cross Sectional ◽  
Content Validity Index

Background: Patient satisfaction has been revealed to affect patient outcomes and has been used as an indicator for measuring quality in health care. However, there are no culturally appropriate instruments that measure Filipino patient satisfaction receiving nursing care.Objective: The objective of the study is to examine the validity and reliability of the Filipino version of Patient Satisfaction Instrument (F-PSI).Methods: The study utilized a cross-sectional study and included 131 Filipino patients in selected hospitals in Manila and were selected through convenience sampling. The tool undergone cross cultural adaptation following the WHO guidelines. Also, content validity following Davis technique and construct validity through confirmatory factor analysis was done to assessed its validity. To measure its internal consistency reliability, Cronbach’s α, inter-item and total-item correlation was conducted.Results: The construct validity of the Filipino version of PSI showed a good model fit while the item content validity index (I-CVI) ranges from 0.83-1.0 and a scale content validity index (S-CVI) of 0.96. Also, the translated tool showed an acceptable internal consistency reliability.Conclusion: The Filipino PSI is a valid and reliable instrument for measuring satisfaction among Filipino patients. Supplementary studies are needed to ascertain its validity and reliability for clinical use.

scholarly journals The Design and Validation of an Azeri Phonological Test for Children Aged 4-6 Years

2021 ◽  
Vol 19 (4) ◽  
pp. 379-386
Author(s):  
Zeynab Khoshhal ◽  
◽  
Ali Jahan ◽  
Majid Mirzaee ◽  
Fatemeh Haresabadi ◽  
...  
Keyword(s):  
Internal Consistency ◽  
Content Validity ◽  
Statistical Tests ◽  
First Language ◽  
Intraclass Correlation ◽  
Cluster Sampling ◽  
Validity And Reliability ◽  
Speech Language Pathologists ◽  
Rater Reliability ◽  
Phonological Skills

Objectives: Since there is no reliable and valid tool to assess all features of children’s phonological skills whose first language is Azeri, speech-language pathologists usually use informal or Persian instruments. So, it is essential to develop a tool in Azeri language for assessing articulation and phonological skills. For this reason, this study aimed to develop an Azeri Phonological Test (APT) and then determine the validity and reliability of this test in 4-6 years old children whose first language is Azeri. Methods: Participants were 77 (41 boys and 36 girls; 4-6 years old) typically-developing children. They were selected by cluster sampling method. Firstly, Tabriz City in Iran was geographically divided into three sections, namely south, north, and center. Then, the kindergartens of each area were randomly selected for sampling. The participants were assigned into 2 groups: 48-60 months (n=38) and 61-72 months (n=39) old. To assess the phonological skills, nine stories were designed. An expert panel with 15 speech-language pathologists investigated the content validity of the stories. Then the psychometric characteristics of the APT, including reliability (test-retest reliability, inter-rater, and internal consistency) and validity (construct –known group validity), were assessed. The statistical tests used were intraclass correlation coefficient (intra-rater reliability and test-retest), Kuder-Richardson 21 (internal consistency), and the independent samples t-test (known-groups validity). Results: The content validity of the whole test was 0.91. Construct validity evaluation showed that age affects the test scores but not gender. There was a significant correlation between the results of test-retest and inter-rater reliability, and also, the test had a high internal consistency. Discussion: Based on the findings, APT is a reliable and valid test for assessing the abilities of 4-6 years old children in terms of the production of sounds in the context of retelling stories.

Sign in / Sign up

Export Citation Format

Share Document