Expert Surveys as a Measurement Tool

2016 ◽  
Author(s):  
Cherie Maestas
Keyword(s):  
Political Institutions ◽  
Survey Design ◽  
Questionnaire Design ◽  
Local Context ◽  
Measurement Tool ◽  
Political Elites ◽  
Validity And Reliability ◽  
Alternative Strategies ◽  
Expert Surveys ◽  
Key Questions

Polling political elites, academics, or other types of knowledgeable experts has provided scholars with a trove of information about political institutions, processes, and local context. Expert surveys are an especially useful method for measuring concepts that would be difficult or impossible to measure through alternative strategies and permits scholars to create indicators that are comparable across diverse contextual settings. This chapter provides an overview of the key questions researchers face when using experts as a tool of measurement. It highlights considerations regarding survey design, questionnaire design, and aggregation procedures with an eye toward identifying ways to enhance the validity and reliability of expert-based measures. The chapter also emphasizes the importance of design transparency and systematic reporting of procedures and measures of uncertainty about scores derived from expert surveys.

The Turkish Adaptation of the Triangular Relationship Inventory: The Validity and Reliability Study

2021 ◽  
pp. 106648072110230
Author(s):  
Çiğdem Yavuz Güler
Keyword(s):  
Psychometric Properties ◽  
Convergent Validity ◽  
Goodness Of Fit ◽  
Satisfaction With Life ◽  
Family System ◽  
Measurement Tool ◽  
Tension Stress ◽  
Validity And Reliability ◽  
The Family ◽  
Triangular Relationship

Objective: According to the family systems theory, triangulation is defined as reflecting and conveying the tension between two individuals to a third individual to reduce the existing tension, stress, and anxiety. This study was conducted to adapt the “Triangular Relationship Inventory” to Turkish and to assess psychometric properties. Method: The sample of the study included 337 individuals (234 women and 103 men) aged between 18 and 25 years. The structure validity of the inventory was evaluated with the confirmatory factor analysis and reliability was evaluated with Chronbach's alpha internal consistency coefficient, test–retest method, and item analyses. Results: The result showed that the Turkish form of the Triangular Relationship Inventory showed similar psychometric properties to the original inventory. The structure which consists of the balanced, mediator, cross-generational coalition, and scapegoat subdimensions of 24 items displayed acceptable goodness-of-fit values in the Turkish sample with the 0.91 Cronbach's alpha coefficient while the reliability values of the subdimensions changed between 0.86 and 0.91. Considering the convergent validity of the inventory, there was a negative correlation between the triangular relationship and satisfaction with life and the differentiation of self, and a significant positive correlation with depression, anxiety, and stress. Conclusion: The psychometric properties revealed in this study show that the Turkish form of the Triangular Relationship Inventory is a valid and reliable measurement tool that can be used to measure the triangulation levels and roles of the individuals, who are in the Turkish sample and between the ages of 18 and 25 years, within the family system.

scholarly journals Medical artificial intelligence readiness scale for medical students (MAIRS-MS) – development, validity and reliability study

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Ozan Karaca ◽  
S. Ayhan Çalışkan ◽  
Kadir Demir
Keyword(s):  
Artificial Intelligence ◽  
Factor Analysis ◽  
Medical Students ◽  
Data Science ◽  
Factor Model ◽  
Health Science ◽  
Measurement Tool ◽  
Validity And Reliability ◽  
Mathematical Concepts ◽  
Evaluation And Monitoring

Abstract Background It is unlikely that applications of artificial intelligence (AI) will completely replace physicians. However, it is very likely that AI applications will acquire many of their roles and generate new tasks in medical care. To be ready for new roles and tasks, medical students and physicians will need to understand the fundamentals of AI and data science, mathematical concepts, and related ethical and medico-legal issues in addition with the standard medical principles. Nevertheless, there is no valid and reliable instrument available in the literature to measure medical AI readiness. In this study, we have described the development of a valid and reliable psychometric measurement tool for the assessment of the perceived readiness of medical students on AI technologies and its applications in medicine. Methods To define medical students’ required competencies on AI, a diverse set of experts’ opinions were obtained by a qualitative method and were used as a theoretical framework, while creating the item pool of the scale. Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) were applied. Results A total of 568 medical students during the EFA phase and 329 medical students during the CFA phase, enrolled in two different public universities in Turkey participated in this study. The initial 27-items finalized with a 22-items scale in a four-factor structure (cognition, ability, vision, and ethics), which explains 50.9% cumulative variance that resulted from the EFA. Cronbach’s alpha reliability coefficient was 0.87. CFA indicated appropriate fit of the four-factor model (χ2/df = 3.81, RMSEA = 0.094, SRMR = 0.057, CFI = 0.938, and NNFI (TLI) = 0.928). These values showed that the four-factor model has construct validity. Conclusions The newly developed Medical Artificial Intelligence Readiness Scale for Medical Students (MAIRS-MS) was found to be valid and reliable tool for evaluation and monitoring of perceived readiness levels of medical students on AI technologies and applications. Medical schools may follow ‘a physician training perspective that is compatible with AI in medicine’ to their curricula by using MAIRS-MS. This scale could be benefitted by medical and health science education institutions as a valuable curriculum development tool with its learner needs assessment and participants’ end-course perceived readiness opportunities.

scholarly journals Designing Valid and Reliable Vignette Experiments for Survey Research: A Case Study on the Fair Gender Income Gap

2017 ◽  
Vol 7 (2) ◽  
Author(s):  
Peter M. Steiner ◽  
Christiane Atzmüller ◽  
Dan Su
Keyword(s):  
Experimental Design ◽  
Construct Validity ◽  
Factorial Design ◽  
Survey Research ◽  
Survey Design ◽  
Validity And Reliability ◽  
Design Elements ◽  
The Real ◽  
Income Gap

In survey research, vignette experiments typically employ short, systematically varied descriptions of situations or persons (called vignettes) to elicit the beliefs, attitudes, or behaviors of respondents with respect to the presented scenarios. Using a case study on the fair gender income gap in Austria, we discuss how different design elements can be used to increase a vignette experiment’s validity and reliability. With respect to the experimental design, the design elements considered include a confounded factorial design, a between-subjects factor, anchoring vignettes, and blocking by respondent strata and interviewers. The design elements for the sampling and survey design consist of stratification, covariate measurements, and the systematic assignment of vignette sets to respondents and interviewers. Moreover, the vignettes’ construct validity is empirically validated with respect to the real gender income gap in Austria. We demonstrate how a broad range of design elements can successfully increase a vignette study’s validity and reliability.

Oil to cash in Somaliland: a debate whose time has come

2018 ◽  
Vol 56 (4) ◽  
pp. 619-643
Author(s):  
Scott Pegg
Keyword(s):  
Political Institutions ◽  
Resource Curse ◽  
Significant Risk ◽  
The Political ◽  
Political Elites ◽  
Annual Budget ◽  
Political Resource ◽  
Democratic Election ◽  
Oil Revenues ◽  
Direct Distribution

AbstractSomaliland might start producing oil in 2019. Yet, it has done little to prepare for the arrival of oil revenues which could exceed its current annual budget. Although Somaliland has been largely peaceful for two decades and recently inaugurated its fifth president after holding a democratic election, it remains entirely unrecognised. Oil revenues could positively transform Somaliland's fragile political economy, but they also place it at significant risk for a political resource curse that could threaten its democracy, peace and political institutions. Oil to cash or the direct distribution of oil revenues to citizens has been posited as a solution to the political resource curse. Somaliland has many of the elements necessary to make oil to cash work in place. Several factors combine to make Somaliland both potentially receptive to oil to cash and uniquely positioned to benefit from it. Interviews with political elites demonstrate receptiveness to the idea. Sample revenue calculations from other African oil producers highlight just how such a system could work to benefit Somaliland.

Cultural safety in hospitals: validating an empirical measurement tool to capture the Aboriginal patient experience

2020 ◽  
Vol 44 (2) ◽  
pp. 205
Author(s):  
Elissa Elvidge ◽  
Yin Paradies ◽  
Rosemary Aldrich ◽  
Carl Holder
Keyword(s):  
Patient Perspective ◽  
New South ◽  
New South Wales ◽  
Performance Measure ◽  
Cultural Safety ◽  
Measurement Tool ◽  
Local Health ◽  
Validity And Reliability ◽  
South Wales ◽  
Aboriginal Patient

ObjectiveThe aim of the present study was to develop a scale to measure cultural safety in hospitals from an Aboriginal patient perspective. MethodsThe Cultural Safety Survey was designed to measure five key characteristics of cultural safety that contribute to positive hospital experiences among Aboriginal hospital patients. Investigators developed a range of different methods to assess the validity and reliability of the scale using a sample of 316 participants who had attended a New South Wales hospital in the past 12 months. Targeted recruitment was conducted at two hospital sites. Opportunistic recruitment took place through a local health district, discharge follow-up service and online via social media. ResultsThe Cultural Safety Survey Scale was a robust measurement tool that demonstrated a high level of content and construct validity. ConclusionThe Cultural Safety Survey Scale could be a useful tool for measuring cultural safety in hospitals from the Aboriginal patient perspective. What is known about the topic?There are increasing calls by governments around the world for health institutions to enhance the cultural safety of their services as one way of removing access barriers and increasing health equity. However, currently there are no critical indicators or systematic methods of measuring cultural safety from the patient perspective. What does this paper add?The cultural safety scale, an Australian first, presents the first empirically validated tool that measures cultural safety from the Aboriginal patient perspective. What are the implications for practitioners?This measurement model will allow hospitals to measure the cultural safety of their services and ascertain whether current efforts aimed to improve cultural safety are resulting in Aboriginal patients reporting more culturally safe experiences. Over time it is hoped that the tool will be used to benchmark performance and eventually be adopted as a performance measure for hospitals across New South Wales.

scholarly journals Development of Distance Education Attitude Scale for Teachers: A Study of Validity and Reliability

2021 ◽  
Vol 5 (2) ◽  
pp. 207-222
Author(s):  
Serpil Deniz ◽  
Birsen Bağçeci
Keyword(s):  
Distance Education ◽  
Attitude Scale ◽  
Measurement Tool ◽  
Fit Indices ◽  
Validity And Reliability ◽  
Reliable Measurement ◽  
Two Factors ◽  
Bartlett Test ◽  
Teachers Attitudes ◽  
Composite Reliability

The purpose of this study is to examine the validity and reliability of the Distance Education Attitude Scale for Teachers, which was developed to reveal teachers’ attitudes towards distance education during the COVID-19 outbreak. Statistical analyses were performed on 458 of the collected forms. The study group was randomly divided into two and the EFA process was conducted with 205 participants and the CFA process with 253 participants. KMO and Bartlett tests were performed to determine the suitability of the data for EFA. The KMO value was 0.0885 and the Bartlett test was statistically significant (χ2=3141, df=703, p<0.001). EFA results show that the DEASFT structure consists of 21 items and two factors, and these factors are named as “Benefits of Distance Education” and “Limitations of Distance Education”. CFA was applied on the data of 253 different people to the factor structures obtained as a result of AFA Analyses. One item was dropped from the scale because p values (0.178) is bigger than 0.05. According to fit indices (χ²/df < 1.5, CFI=0.953 > 0.9, TLI=0.942 > 0.9, SRMR=0.0735 < 0.8, RMSEA=0.0427 < 0.05), the scale is validated. The final version of scale has two factors and 20 items. Cronbach Alpha and composite reliability coefficients were calculated for reliability. For factor 1 Cronbach α=0.847 and McDonald’s ω=0.836. For factor 2 Cronbach α=0.815 and McDonald’s ω=0.845. The results of the analysis show that the scale is a valid and reliable measurement tool for determining teachers’ attitudes towards distance education.

scholarly journals VALIDITY AND RELIABILITY OF REBT MODULE CREATIVE GUIDANCE ON IRRATIONAL THINKING, AGGRESSIVE BEHAVIOR, AND SELF-ESTEEM

2020 ◽  
Vol 5 (37) ◽  
pp. 283-296
Author(s):  
Ibrahim Abd Ghani ◽  
Norsayyadatina Che Rozubi
Keyword(s):  
Primary School ◽  
Aggressive Behavior ◽  
Well Being ◽  
Self Esteem ◽  
Local Context ◽  
Validity And Reliability ◽  
Primary School Students ◽  
Albert Ellis ◽  
School Students ◽  
Rational Emotive

Rational Emotive Behavioural Therapy (REBT) Module - Creative Guidance is designed to prevent irrational thoughts, lower aggressive behavior, and increase self-esteem. This module contains seven sub-modules based on behavioral approaches based on the theory of Rational Emotive Behavior Therapy (REBT) by Albert Ellis (1955) and integrated with creative Guidance. It combines elements of Music, technology, and play. To measure the validity of the content, the certification method by five experts was used while 40 primary school students aged 11 years were selected to follow the guidance program using this module. It is run for two weeks in a row. The findings of the study show that the REBT-Creative Guidance Module has a content validity index value of 80%., The cost of Cronbach's Alpha coefficient of Creative REBT-Guidance Module is high at .978. Reliability with an amount.930 In conclusion, new contributions to guidance and counseling teachers in Malaysia. It is also suitable for use in a local context focused on primary school students. Counselors can also use this module, Teachers or facilitators as one of the alternative interventions for primary school students throughout Malaysia, especially on the Development and Development of Student Personality, Improving Student Discipline, Improving Student Careers and Psychosocial and Mental Well-Being.

scholarly journals Examining virtual identity profiles of social network users with respect to certain variables

2020 ◽  
Vol 10 (2) ◽  
pp. 427-464
Author(s):  
Esra Barut Tuğtekin ◽  
Özcan Özgür Dursun
Keyword(s):  
Social Networks ◽  
Social Network ◽  
Identity Management ◽  
Research Process ◽  
Research Data ◽  
Total Variance ◽  
Measurement Tool ◽  
Validity And Reliability ◽  
Cronbach Alpha ◽  
The Social

In the present study, a measurement tool was developed to determine the virtual identities of social network users, and the virtual identities of these social network users were examined with respect to gender, time spent on social networks, number of their social network profiles and visibility using the relational survey model. The study was carried out with a total of 671 social network users, 252 females and 419 males. The research data were collected using the Social Network Identity Management Scale developed within the scope of the study. The five-point Likert-type scale made up of four factors and 23 items was found to explain 55.29 % of the total variance (Cronbach Alpha =.93). At the end of the research process, a 23-item Social Network Identity Management Scale’s validity and reliability were confirmed. The finding obtained in the study demonstrated that the virtual identities of the users with more than one profile differed within the context of such sub-dimensions of the scale as liking and privacy. In addition, it was found that the changes in the virtual identities increased depending on the time spent on social networks.

scholarly journals Validity and reliability of Korean version Competency Assessment Tool-Mental Health

2020 ◽  
Vol 7 (2) ◽  
pp. 143-152
Author(s):  
Hyun Mee Cho ◽  
Jeong Won Han ◽  
Eun Joung Choi ◽  
Hyo Eun Jeong ◽  
Bo Ram Hong ◽  
...  
Keyword(s):  
Mental Health ◽  
Health Care ◽  
Mental Health Care ◽  
Internal Consistency ◽  
Assessment Tool ◽  
Reliability And Validity ◽  
Basic Data ◽  
Measurement Tool ◽  
Competency Assessment ◽  
Validity And Reliability

AbstractObjectiveTo establish basic data for identifying the level of mental health care competency of general nurses through verification of the reliability and validity of Competency Assessment Tool-Mental Health in the development of a measurement tool for mental health care competency in Korea.MethodsThis study was conducted on nurses working at general wards, excluding those working at the Department of Psychiatry, in five hospitals with 200 beds or more located in Korea. Content, construct, concurrent validity, and internal consistency of the measurement were confirmed.ResultsAs a result of the construct validity, the section on importance of skills and knowledge for mental health care had 21 items, whereas the section on benefits of additional education had 22 items. The internal consistency of measurement was confirmed as follows: Cronbach's α = 0.96 for the section on importance and 0.96 for the section on benefits section.ConclusionsThis study verified the high validity and reliability of the tool in assessing the mental health care competency of nurses, and it is believed to be significant as basic data for enhancing such competency.

Fictions of Migration and Refuge from the Anthropocene

2019 ◽  
pp. 175-217
Author(s):  
John Patrick Walsh
Keyword(s):  
Natural Disaster ◽  
Political Violence ◽  
Political Institutions ◽  
Social Worlds ◽  
Time And Space ◽  
The Future ◽  
Cast Doubt ◽  
Shared Humanity ◽  
Scientific Debates ◽  
Key Questions

The chapter treats a set of writers, Louis-Philippe Dalembert, Gary Victor, and Néhémy Pierre-Dahomey, whose fictions imagine experiences of migration and refuge in the wake of political and natural disaster. Their texts are meditations on the stakes of social and political institutions that support life in common in an age of ecological reckoning. The first part of the chapter returns to key questions of the Anthropocene, raised in the introduction, in order to demonstrate the ways that Caribbean thinkers have long anticipated scientific debates about the links between political violence and the future of the planet. Literary eco-archives contribute to these debates with stories about social worlds migrating and colliding. The chapter argues that Dalembert’s Ballade d’un amour inachevé, Victor’s Maudite éducation and its sequel L’Escalier de mes désillusions, and Pierre-Dahomey’s Rapatriés cast doubt on the future of a shared humanity with portraits of Haitian lives that foreground an ethics of vulnerability amidst widespread inequality. Through poetic representations of time and space, each writer ponders the ephemeral beauty of the present, always in flux between past and present, and each imagines the frailty of human lives in increasingly inhospitable climes.

Sign in / Sign up

Export Citation Format

Share Document