scholarly journals Psychometric Evaluation of the Cybersecurity Concept Inventory

2022 ◽  
Vol 22 (1) ◽  
pp. 1-18
Author(s):  
Seth Poulsen ◽  
Geoffrey L. Herman ◽  
Peter A. H. Peterson ◽  
Enis Golaszewski ◽  
Akshita Gorti ◽  
...  
Keyword(s):  
Psychometric Evaluation ◽  
Colleges And Universities ◽  
Concept Inventory ◽  
Small Scale ◽  
Pilot Testing ◽  
Expert Review ◽  
Reliable Tool ◽  
Instruction Quality

We present a psychometric evaluation of a revised version of the Cybersecurity Concept Inventory (CCI) , completed by 354 students from 29 colleges and universities. The CCI is a conceptual test of understanding created to enable research on instruction quality in cybersecurity education. This work extends previous expert review and small-scale pilot testing of the CCI. Results show that the CCI aligns with a curriculum many instructors expect from an introductory cybersecurity course, and that it is a valid and reliable tool for assessing what conceptual cybersecurity knowledge students learned.

Initial Validation of the Cybersecurity Concept Inventory: Pilot Testing and Expert Review

2019 ◽  
Author(s):  
Spencer Offenberger ◽  
Geoffrey L. Herman ◽  
Peter Peterson ◽  
Alan T Sherman ◽  
Enis Golaszewski ◽  
...  
Keyword(s):  
Concept Inventory ◽  
Pilot Testing ◽  
Expert Review ◽  
Initial Validation

The Measurement of Transitions in Cancer Scale

2017 ◽  
Vol 25 (1) ◽  
pp. 103-120 ◽  
Author(s):  
Dena Schulman-Green ◽  
Sangchoon Jeon ◽  
Ruth McCorkle ◽  
Jane Dixon
Keyword(s):  
Convergent Validity ◽  
Treatment Approach ◽  
Care Transitions ◽  
Psychometric Evaluation ◽  
Target Population ◽  
Cognitive Interviews ◽  
Expert Review ◽  
Life Phase ◽  
Additional Testing ◽  
Health And Illness

Background and Purpose: Health-illness transitions are changes in life phase, situation, or status related to shifts between health and illness. We report on the development and psychometric evaluation of the Measurement of Transitions in Cancer Scale (MOT-CA), a 7-item instrument that assesses extent and management of a range of transitions experienced by cancer patients. Methods: We identified content domains, developed operational definitions, generated items, conducted expert review (n = 7) and cognitive interviews (n = 13), and tested MOT-CA with our target population (n = 105). Results: MOT-CA has content and convergent validity and a 2-factor structure consisting of Personal Transitions (physical, emotional, social, spiritual; eigenvalue = 2.994) and Care Transitions (cancer status, treatment, approach to care; eigenvalue = 1.444). Conclusion: Although additional testing is indicated, the MOT-CA is valid, brief, and acceptable.

Psychometric evaluation of a short observational tool for small-scale research projects in dementia

2001 ◽  
Vol 16 (3) ◽  
pp. 288-292 ◽  
Author(s):  
Jonathan Smallwood ◽  
Elizabeth Irvine ◽  
Fiona Coulter ◽  
Hazel Connery
Keyword(s):  
Psychometric Evaluation ◽  
Small Scale ◽  
Research Projects ◽  
Observational Tool

scholarly journals Development and Validation of an Online Survey to Assess Perception of Diabetes Risk and Barriers and Facilitators to Weight Loss Following Gestational Diabetes

2021 ◽  
Vol 18 (2) ◽  
pp. 480
Author(s):  
Kristy L. Gray ◽  
Mayya Grebenshchikova ◽  
Sharleen L. O’Reilly ◽  
Lois McKellar ◽  
Peter M. Clifton ◽  
...  
Keyword(s):  
Weight Loss ◽  
Gestational Diabetes ◽  
Theoretical Domains Framework ◽  
Diabetes Risk ◽  
Expert Evaluation ◽  
Content Validation ◽  
Pilot Testing ◽  
Response Options ◽  
Expert Review ◽  
Development And Validation

Our objective was to describe the development and validation of a survey investigating barriers to weight loss, perception of diabetes risk, and views of diet strategies following gestational diabetes (GDM). The survey underwent three stages of development: generation of items, expert evaluation, and pilot testing. A content validation index (CVI) was calculated from expert responses regarding item relevance, coherence, clarity, and response options. Experts also responded to the domain fit of questions linked to the Theoretical Domains Framework (TDF). Pilot responders answered the survey and responded to review questions. Six experts in the field of nutrition, midwifery, psychology, or other health or medical research completed the expert review stage of the survey. In the pilot test, there were 20 responders who were women with previous GDM and who were living in Australia. The overall CVI from the expert review was 0.91. All questions except one received an I-CVI of >0.78 for relevance (n = 35). Fourteen of the 27 items linked to the TDF received an agreement ratio of <1.0. Twenty-seven of the 31 pilot questions were completed by ≥90% of responders. Pilot review questions revealed an agreement percentage of ≥86% (n = 12) regarding the survey’s ease to complete, understand, importance, length, and interest level. The final survey tool consists of 30 items and achieved content validation through expert evaluation and pilot testing.

Development and Testing of the Nursing Role Model Competence Scale (NRMCS)

1995 ◽  
Vol 3 (2) ◽  
pp. 93-108 ◽  
Author(s):  
Mary R. Lynn
Keyword(s):  
Role Models ◽  
Role Model ◽  
Professional Socialization ◽  
Psychometric Evaluation ◽  
Reliability Estimation ◽  
Nursing Role ◽  
Expert Review ◽  
Validity Assessment ◽  
Educational Role ◽  
Competence Scale

Although contact with appropriate role models is considered essential for adequate professional socialization, no instruments exist for the measurement of role modeling or role model competence in nursing. The aim of this study was to develop and test a measure of perceived role model competence. Initial item sources for the Nursing Role Model Competence Scale (NRMCS) were literature-based. Twenty nine items were compiled for content validity assessment by two panels of persons identified as clinical and educational role models. Eight additional items were added as a result of the expert review and mailed to 2,000 baccalaureate and higher degree nurses in a southwestern state. Of the 1,053 respondents, 951 provided complete data on the NRMCS. Psychometric evaluation of the NRMCS included item-total correlations (.42-.70), principal axis factor analysis with varimax rotation (51% of the variance accounted for), reliability estimation using alpha and theta estimates (>.77) and item-factor correlations (.41-.70). The four NRMCS factors—Positive Regard, Competence, Assertive Leader and Professional Advocate—were statistically compared, with five of the six comparisons resulting in significant differences. Respondents with higher professional scores were found to rate their role models as more competent on the NRMCS factors.

Enhanced Oil Recovery Pilot Testing Best Practices

2010 ◽  
Vol 13 (01) ◽  
pp. 143-154 ◽  
Author(s):  
G.F.. F. Teletzke ◽  
R.C.. C. Wattenbarger ◽  
J.R.. R. Wilkinson
Keyword(s):  
Best Practices ◽  
Enhanced Oil Recovery ◽  
Oil Recovery ◽  
Large Scale ◽  
Full Range ◽  
Mobility Control ◽  
Small Scale ◽  
Pilot Testing ◽  
Advantages And Disadvantages ◽  
Eor Processes

Summary Enhanced-oil-recovery (EOR) implementation is complex, and successful applications need to be tailored to each specific reservoir. Therefore, a systematic staged evaluation and development process is required to screen, evaluate, pilot test, and apply EOR processes for particular applications. Pilot testing can play a key role in this process. Before field testing, pilot objectives need to be clearly defined and well spacing, pattern configuration, and injectant volumes determined. This paper outlines a staged approach to EOR evaluation and focuses specifically on pilot testing best practices. These best practices were derived from ExxonMobil's extensive piloting experience, which includes more than 50 field pilot tests covering the full range of EOR processes. Topics covered include: (1) determining whether a pilot is needed and defining pilot objectives, (2) considerations for successful pilot design, (3) types of pilots and their advantages and disadvantages, (4) tools and techniques for assessment of key reservoir mechanisms, and (5) minimizing uncertainty in pilot interpretation. Key issues that are often addressed by pilots are discussed, including areal sweep and conformance, gravity override, viscous fingering, and loss of mobility control. Also included are aspects of instrumentation and measurements in pilot injection, production, and monitoring wells. Several ExxonMobil piloting examples are used to illustrate the best practices, including a single-well injectivity test, an unconfined pilot with observation wells, a small-scale confined pilot, and a large-scale multipattern pilot.

scholarly journals Psychometric Evaluation of the Caregiver Needs Screen in Neuro-Oncology Family Caregivers

2019 ◽  
Vol 27 (2) ◽  
pp. 162-176
Author(s):  
Florien W. Boele ◽  
Lauren Terhorst ◽  
Jennifer Prince ◽  
Heidi S. Donovan ◽  
Jason Weimer ◽  
...  
Keyword(s):  
Internal Consistency ◽  
Convergent Validity ◽  
Reliability And Validity ◽  
Psychometric Evaluation ◽  
Well Being ◽  
Internal Consistency Reliability ◽  
Preliminary Evidence ◽  
Expert Review ◽  
Scale Scores ◽  
Caregiver Needs

Background and PurposeThe informal care demands of primary malignant brain tumor (PMBT) patients include unique issues associated with neurological and cognitive symptoms. Existing caregiver needs questionnaires do not include these disease-specific symptoms, which are particularly distressing. Therefore, we have developed the neuro-oncology Caregiver Needs Screen (CNS) and evaluated its psychometric properties.MethodsThe 32-item instrument was developed based on PMBT caregiver interviews (N = 109) and expert review. The CNS was tested along measures of depression, anxiety, burden, and mastery in 122 PMBT caregivers. Principal components analysis was used to examine item properties and internal structure. Internal consistency reliability and construct validity were assessed.ResultsSix subscales were identified with internal consistency ranging between alpha = .653 and .857. Convergent validity was verified by moderate/high correlations between measures of caregiver well-being and CNS scale scores.ConclusionsFindings provide preliminary evidence of reliability and validity for the CNS. This instrument can be useful when assessing caregivers' needs for supportive care.

A measure of case complexity for cancer multidisciplinary teams: Development and early validation of the MeDiC tool

2019 ◽  
Author(s):  
Tayana Soukup ◽  
Abigail Morbi ◽  
Ben W Lamb ◽  
Tasha Gandamihardja ◽  
Katy Hogben ◽  
...  
Keyword(s):  
Phase 1 ◽  
Psychometric Evaluation ◽  
Tumor Board ◽  
Multidisciplinary Teams ◽  
Content Validation ◽  
Expert Review ◽  
Case Complexity ◽  
Ethnographic Interviews ◽  
Tumor Boards ◽  
Early Validation

Background and Objective. There is increasing emphasis in cancer care globally for care to be reviewed and managed by multidisciplinary teams (i.e., in tumor boards). Evidence and recommendations suggest that the complexity of each patient case needs to be considered as care is planned, however no tool currently exists for cancer teams to do so. We report the development and early validation of such a tool.Methods. We used a mixed-methods approach involving psychometric evaluation and expert review to develop the Measure of case-Discussion Complexity (MeDiC) between May 2014 and November 2016. The study ran in 6 phases and included ethnographic interviews, observations, surveys, feasibility and reliability testing, expert consensus, and multiple expert-team reviews.Results. Phase-1: case complexity factors identified through literature review and expert interviews; Phase-2: 51 factors subjected to iterative review and content validation by 9 cancer teams across 4 England Trusts with 9 further items identified; Phase 3: 60-items subjected to expert review distilled to the most relevant; Phase 4: item weighing and further content validation through a national UK survey. Phases 5 and 6: excellent inter-assessor reliability between clinical and non-clinical observers, and adequate validity on 903 video case-discussions achieved. A final set of 27 factors, measuring clinical and logistical complexities were integrated into MeDiC.Conclusions. MeDiC is an evidence-based and expert-driven tool that gauges the complexity of cancer cases. MeDiC may be used as a clinical quality assurance and screening tool for tumor board consideration through case selection and prioritization.

A psychometric evaluation of the digital logic concept inventory

2014 ◽  
Vol 24 (4) ◽  
pp. 277-303 ◽  
Author(s):  
Geoffrey L. Herman ◽  
Craig Zilles ◽  
Michael C. Loui
Keyword(s):  
Psychometric Evaluation ◽  
Digital Logic ◽  
Concept Inventory

Development and Psychometric Evaluation of the Counseling Women Competencies Scale (CWCS)

2008 ◽  
Vol 36 (5) ◽  
pp. 719-744 ◽  
Author(s):  
Julie R. Ancis ◽  
Dawn M. Szymanski ◽  
Nicholas Ladany
Keyword(s):  
Graduate Students ◽  
Factor Model ◽  
Psychometric Evaluation ◽  
Internal Consistency Reliability ◽  
Incremental Validity ◽  
Self Awareness ◽  
Review Of The Literature ◽  
Therapeutic Practice ◽  
Expert Review ◽  
Female Clients

This article describes the development and psychometric evaluation of the Counseling Women Competencies Scale (CWCS). The CWCS is designed to assess clinicians' self-perceived competencies with regard to therapeutic practice with diverse female clients. Through an extensive review of the literature on counseling women and expert review by 32 members of the Section for the Advancement of Women (Division 17, APA), content validity was supported. Exploratory factor analysis, conducted on a sample of 321 male and female counseling and psychology graduate students and professionals, supported a two-factor model consisting of knowledge/skills and self-awareness factors. Findings also provided support for the internal consistency reliability and construct (convergent, divergent, and incremental) validity of the scale.

Sign in / Sign up

Export Citation Format

Share Document