scholarly journals Development and Initial Psychometric Properties of the Integrated Care Competency Scale for Counselors

SAGE Open ◽  
2019 ◽  
Vol 9 (3) ◽  
pp. 215824401987078
Author(s):  
Bridget Asempapa ◽  
Reuben S. Asempapa
Keyword(s):  
Psychometric Properties ◽  
Integrated Care ◽  
Quantitative Methods ◽  
Phase 1 ◽  
Counseling Students ◽  
Future Research ◽  
Reliability Factor ◽  
Phase Study ◽  
Three Phase ◽  
Study Process

This study provides the development phases and initial psychometric evaluation of the Integrated Care Competency Scale (ICCS) with sample ( n = 243). Specifically, quantitative methods with graduate counseling students were used in this study. The ICCS through a three-phase study process was honed to 65 items and broadly assesses graduate counseling students’ perceived competencies in integrated care. Phase 1 reports on item generation and issues related to content validity, Phase 2 describes the results of a pilot study and preliminary psychometric properties, and Phase 3 discusses the exploratory factor analysis, and further psychometric properties conducted to assess the usefulness and reliability of the ICCS items. Results from the three-phase study process revealed satisfactory reliability, factor structure, and usefulness of the newly constructed ICCS in measuring integrated care competencies. Cronbach’s alpha coefficient for the overall scale was .98. Discussion, limitation, and implications for future research are presented.

scholarly journals An Examination of Distributional Characteristics & Psychometric Properties of Rating Scales Under Different Scale Label Configurations

2021 ◽  
Author(s):  
Alfonso J. Martinez
Keyword(s):  
Psychometric Properties ◽  
Time Management ◽  
Rating Scales ◽  
Factorial Invariance ◽  
Future Research ◽  
Reliability Factor ◽  
Latent Constructs ◽  
The Social ◽  
Academic Time ◽  
Indispensable Tool

Rating scales (e.g., Likert scales) have become an indispensable tool in the social sciences for measuring latent constructs. Despite their practicality, it is well known that rating scales are sensitive to design choices made during the scale construction process. In the present study, we investigate the effects of different scale labeling configurations on the distributional characteristics and psychometric properties of rating scales by analyzing data from two 7-point rating scales that were altered with respect to their scale labels. Specifically, we investigate the differences in composite score means, variances, reliability, factor structure, and measurement invariance (i.e., metric, scalar, and strict factorial invariance) of two scales that measure divergent constructs (life satisfaction life; academic time management & procrastination). Results indicate that distributional characteristics of rating scales are affected by differences in labeling configurations to varying degrees, however the psychometric properties of the scales are not influenced by changes in labeling. In particular, it was found that strict factorial invariance held, indicating that the scales, although different with respect to scale labels, maintain equal difficulty, discrimination between groups. Implications and recommendations for scale developers and directions for future research are discussed.

Adverse Childhood Experiences (ACEs): Development of an ACEs Knowledge Scale

2021 ◽  
pp. JNM-D-20-00117
Author(s):  
Lin Zhan ◽  
Xichen Mou ◽  
Marie Gill
Keyword(s):  
Nursing Students ◽  
Psychometric Properties ◽  
Content Validity ◽  
Adverse Childhood Experiences ◽  
Future Research ◽  
Childhood Experiences ◽  
Reliability Factor ◽  
Adverse Childhood ◽  
Key Concepts ◽  
Knowledge Scale

Background and PurposeAdverse childhood experiences (ACEs) negatively impacting children’s health and later in their lives warrant necessity to educate nursing students about ACEs. The purposes of this study were to evaluate (a) nursing students' understanding of key concepts of ACEs using the ACEs Knowledge Scale (AKS) and (b) psychometric properties of the AKS.MethodsA survey using AKS was conducted with randomly selected student participants (n = 344) to evaluate students' understanding of ACEs knowledge. Empirical validation of the AKS included content validity using Content Validity Index (CVI), reliability, and construct validity analyses.ResultsThe results showed students in the Bachelor of Science in Nursing (BSN) program had increased knowledge of ACEs over pre-nursing students, and the BSN graduating students had increased knowledge related to trauma-informed care and building resilience. There were no significant differences in ACEs knowledge between Family Nurse Practitioner (FNP) and BSN students. Evaluation of psychometric properties of AKS revealed S-CVI/Ave=0.912, indicated excellent content validity based on the expert panel’s ratings. Cronbach’s alpha coefficient = .84 for the overall instrument indicated good reliability. Factor analyses were employed, showing that the 5-factor model gives good fit indexes, supporting the hypothesized factor structure of five key concepts.ConclusionsThe AKS has showed promising implications to future research, nursing education, and nursing practice.

scholarly journals External Quality Assessment of Transporting Infectious Substances in Canada

1999 ◽  
Vol 10 (3) ◽  
pp. 246-251
Author(s):  
Shelley M Tiffin ◽  
Michael A Noble
Keyword(s):  
Phase 1 ◽  
Phase 3 ◽  
Laboratory Observation ◽  
Common Error ◽  
Absorbent Material ◽  
Dangerous Goods ◽  
Phase Study ◽  
Three Phase ◽  
Immunodeficiency Virus ◽  
Private Laboratory

OBJECTIVE: To determine the degree of compliance with Transport Canada’s Transportation of Dangerous Goods Regulations for transporting infectious substances in Canada.DESIGN: A three-phase study including observation of packages arriving at the British Columbia Centre for Disease Control (BCCDC) provincial laboratory; observation of requested samples of either anEscherichia coliculture or serum, not human immunodeficiency virus (HIV) or HbsAg positive, from laboratories; and a questionnaire concerning training and certification of packers in laboratories.RESULTS: During phase 1, 500 packages arriving at the BCCDC provincial laboratory were assessed. All arrived intact, with 384 (76.8%) in a firm outer package. Only 178 (35.6%) contained absorbent material. Six samples were known to contain human immunodefiency virus or hepatitis B; all were appropriately packaged. Of the remainder, 11 (2.2%) were considered overpackaged, 192 (38.4%) acceptably packaged and 191 (38.2%) inadequately packaged. In phase 2, 138 requested packages were assessed. All arrived intact, 132 (95.7%) in a firm outer package. Ninety-six (69.6%) contained absorbent material. Only six (4.3%) were considered inadequately packaged. In phase 3, 171 laboratories responded to a questionnaire. Fifty-nine were from small laboratories, 53 from intermediate laboratories and 23 from large laboratories. Most laboratories (55.4%) relied on in-house resources to train packers. Only 26 (15.3%) facilities had no certified packers, and 60.8% noted they had a formal copy of the regulations available in the laboratory. Laboratory characteristics associated with the likelihood of overpackaging included number of technologists (χ2=5.72; P=0.058), number of samples processed by laboratories (χ2=8.46; P=0.015) and being a private laboratory as opposed to being a hospital laboratory (Fisher Exact two-tailed 0.040).CONCLUSIONS: Canadian laboratories tend to package safely and within the acceptable range of regulation, although not within the precision of regulation. Most laboratories have trained and certified packers. The most common error is the use of outer packaging that is not firm. Larger laboratories tend to overpackage resulting in increased costs.

scholarly journals Specific Disease Knowledge as Predictor of Susceptibility to Availability Bias in Diagnostic Reasoning: a Randomized Controlled Experiment

2020 ◽  
Author(s):  
Sílvia Mamede ◽  
Marco Goeijenbier ◽  
Stephanie C. E. Schuit ◽  
Marco Antonio de Carvalho Filho ◽  
Justine Staal ◽  
...  
Keyword(s):  
Phase 1 ◽  
Diagnostic Errors ◽  
Future Research ◽  
Availability Bias ◽  
Internal Medicine Residents ◽  
Three Phase ◽  
Randomized Controlled Experiment ◽  
Real Practice ◽  
Knowledge Evaluation

Abstract Background Bias in reasoning rather than knowledge gaps has been identified as the origin of most diagnostic errors. However, the role of knowledge in counteracting bias is unclear. Objective To examine whether knowledge of discriminating features (findings that discriminate between look-alike diseases) predicts susceptibility to bias. Design Three-phase randomized experiment. Phase 1 (bias-inducing): Participants were exposed to a set of clinical cases (either hepatitis-IBD or AMI-encephalopathy). Phase 2 (diagnosis): All participants diagnosed the same cases; 4 resembled hepatitis-IBD, 4 AMI-encephalopathy (but all with different diagnoses). Availability bias was expected in the 4 cases similar to those encountered in phase 1. Phase 3 (knowledge evaluation): For each disease, participants decided (max. 2 s) which of 24 findings was associated with the disease. Accuracy of decisions on discriminating features, taken as a measure of knowledge, was expected to predict susceptibility to bias. Participants Internal medicine residents at Erasmus MC, Netherlands. Main Measures The frequency with which higher-knowledge and lower-knowledge physicians gave biased diagnoses based on phase 1 exposure (range 0–4). Time to diagnose was also measured. Key Results Sixty-two physicians participated. Higher-knowledge physicians yielded to availability bias less often than lower-knowledge physicians (0.35 vs 0.97; p = 0.001; difference, 0.62 [95% CI, 0.28–0.95]). Whereas lower-knowledge physicians tended to make more of these errors on subjected-to-bias than on not-subjected-to-bias cases (p = 0.06; difference, 0.35 [CI, − 0.02–0.73]), higher-knowledge physicians resisted the bias (p = 0.28). Both groups spent more time to diagnose subjected-to-bias than not-subjected-to-bias cases (p = 0.04), without differences between groups. Conclusions Knowledge of features that discriminate between look-alike diseases reduced susceptibility to bias in a simulated setting. Reflecting further may be required to overcome bias, but succeeding depends on having the appropriate knowledge. Future research should examine whether the findings apply to real practice and to more experienced physicians.

Developing the Interrater Reliability of the Modified EMDR Fidelity Checklist

2019 ◽  
Vol 13 (1) ◽  
pp. 32-50 ◽  
Author(s):  
Rebecca Z. Cooper ◽  
Anita D. Smith ◽  
David Lewis ◽  
Christopher W. Lee ◽  
Andrew M. Leeds
Keyword(s):  
Interrater Reliability ◽  
Empirical Investigation ◽  
Treatment Fidelity ◽  
Past Research ◽  
The Body ◽  
Future Research ◽  
Phase Study ◽  
Three Phase ◽  
Intraclass Correlations ◽  
Fidelity Measures

Although treatment fidelity measures for eye movement desensitization and reprocessing (EMDR) have been cited in past research, none have been subject to any empirical investigation of reliability. This three-phase study aimed to quantify the interrater reliability of a measure of EMDR treatment fidelity. First, two raters refined the reprocessing section of the EMDR Fidelity Checklist (Leeds, 2016) by developing a descriptive item-by-item scoring system to improve interpretation and reliability. The resultant checklist was piloted on recordings of five EMDR session recordings from the Laugharne et al. (2016) study. The checklist was then revised. Next, the raters used the checklist to assess 15 other recorded EMDR sessions from the same study. The intraclass correlations (ICCs) were in the excellent range for all subscales and total session scores (i.e., >0.75), with an exception of the Desensitization subscale, ICC = 0.69 (0.08, 0.90). Finally, individual items in that subscale were evaluated, finding that five items did not contribute to the ICC. When these were removed/revised, the ICC for this subscale moved into the excellent range, ICC = 0.81(0.43, 0.94). The findings of this study indicate that this checklist may be a reliable measure of treatment fidelity for single reprocessing EMDR sessions with the possible exception of the Body Scan phase. Future research using the checklist with raters who were not involved in checklist development is needed to confirm the generalizability of these findings.

Integrated care competencies: Self-assessment by graduate counseling students

2021 ◽  
Vol 1 (7) ◽  
Author(s):  
Bridget Asempapa ◽  
Reuben S. Asempapa ◽  
Christine S. Bhat
Keyword(s):  
Integrated Care ◽  
Counseling Students ◽  
Self Assessment

Psychometric Properties of a DSM-5-Based Screening Tool for Women's Perceptions of Premenstrual Symptoms

2021 ◽  
pp. 003329412097969
Author(s):  
Meghan A. Richards ◽  
Kirsten A. Oinonen
Keyword(s):  
Psychometric Properties ◽  
Screening Tool ◽  
Physical Symptoms ◽  
Premenstrual Symptom ◽  
Future Research ◽  
Premenstrual Symptoms ◽  
Screening Measure ◽  
Dsm 5 ◽  
Symptom Screening ◽  
Women’S Perceptions

A premenstrual screening tool is needed when time constraints and attrition limit the feasibility of daily ratings. The present study examines the utility of a novel, 33-item, retrospective, dimensional, DSM-5-based, screening measure developed to explore women’s perceptions of premenstrual symptomatology. This is the first measure that examines perception of impairment for each DSM-5 symptom and assesses the frequency criterion. Participants (N = 331) reported symptoms ranging from none to a level consistent with a provisional DSM-5 diagnosis of Premenstrual Dysphoric Disorder (PMDD). Initial psychometric properties indicated a five-factor structure: (1) affective symptoms; (2) fatigue, sleep, and anhedonia; (3) symptom frequency; (4) impairment and severity of appetite change and physical symptoms; and (5) difficulty concentrating. The total symptom scale and the frequency, severity, and impairment subscales demonstrated high internal consistency. Strong correlations between this dimensional measure and other retrospective and prospective premenstrual symptom measures suggest strong convergent, concurrent, and predictive validity. Premenstrual symptom groups created using this screening measure (minimal, mild/moderate, severe) differed on other retrospective and prospective measures of premenstrual symptoms. There was evidence of divergent validity and lack of an acquiescence bias. We also report data describing women’s perceptions of the frequency, level of impairment, and level of severity for each DSM-5 PMDD symptom over a 12-month period and discuss implications for future research on premenstrual phenomenology. Initial evidence for the reliability and construct validity of this symptom screening measure suggests potential value for assessing premenstrual symptomatology in research and practice.

scholarly journals Psychometric properties of a condition-specific PROM for the psychosocial consequences of Labelling hypertension by using Rasch analysis

2021 ◽  
Vol 5 (1) ◽  
Author(s):  
János Valery Gyuricza ◽  
Karl Bang Christensen ◽  
Ana Flávia Pires Lucas d’Oliveira ◽  
John Brodersen
Keyword(s):  
Psychometric Properties ◽  
Rasch Model ◽  
Content Validity ◽  
Model Analysis ◽  
Qualitative Assessment ◽  
Future Research ◽  
Item Pool ◽  
Measurement Models ◽  
Item Functioning ◽  
Psychosocial Consequences

Abstract Background A previous qualitative assessment of the psychosocial consequences of labelling hypertension describes the diagnosis of hypertension as a labelling event with potential unintended negative long-term psychosocial consequences (labelling effects). Until now, the benefits of diagnosing hypertension have been far more reported than the harms. To obtain the net result of the preventive interventions for cardiovascular disease, such as diagnosing and treating mild hypertension, assessing benefits and harms in the most comprehensive way possible is necessary, including the psychosocial consequences of labelling. When measuring psychosocial consequences of labelling hypertension, a questionnaire with high content validity and adequate psychometric properties is needed. Objectives The aim of this study was to describe the psychometric parameters of face and content-validated pool of items. Other objectives were also to screen the item pool by using Rasch model analysis and confirmatory factor analysis (CFA) for identifying such items with sufficient fit to the hypothesised models. Methods We surveyed the pool of items as a draft questionnaire to Brazilians recruited via social networks, sending e-mails, WhatsApp® messages and posting on Facebook®. The inclusion criteria were to be older than 18 years old, to be healthy and to have only hypertension. We used Rasch model analysis to screen the item pool, discarding items that did not fit the hypothesised domain. We searched for local dependence and differential item functioning. We used CFA to confirm the derived measurement models and complementarily assessed reliability using Cronbach’s coefficient alpha. Results The validation sample consisted of 798 respondents. All 798 respondents completed Part I, whereas 285 (35.7%)—those with hypertension—completed Part II. A condition-specific questionnaire with high content validity and adequate psychometric properties was developed for people labelled with hypertension. This measure is called ‘Consequences of Labelling Hypertension Questionnaire’ and covers the psychosocial consequences of labelling hypertension in two parts, encompassing a total of 71 items in 15 subscales and 11 single items. Conclusion We developed a tool that can be used in future research involving hypertension, especially in scenarios of screening, prevention, population strategies and in intervention studies. Future use and testing of the questionnaire may still be required.

Endometrial Adenocarcinoma in SurePath™ Cervical Samples: Cytological Features Revisited

2016 ◽  
Vol 60 (1) ◽  
pp. 46-52 ◽  
Author(s):  
Nalini Gupta ◽  
John Crossley ◽  
Nick Dudding ◽  
John H.F. Smith
Keyword(s):  
Phase 1 ◽  
Endometrial Adenocarcinoma ◽  
Nuclear Chromatin ◽  
Phase 2 ◽  
Cervical Lesions ◽  
Two Phase ◽  
Endometrial Cells ◽  
Phase Study ◽  
Cytological Features ◽  
Liquid Based Cytology

Objective: The cytomorphological criteria of malignant endometrial lesions in cervical samples are less well described than those of cervical lesions. We wished to investigate if there were features in SurePath™ liquid-based cytology samples that would facilitate more accurate differentiation between benign and malignant endometrial cells. Study Design: This was a two-phase study, with a review of all SurePath™ samples reported as endometrial adenocarcinoma (n = 42) evaluating 12 cytological features in the first phase. In phase 2 (test set), all initial cases plus an additional 83 cases were reviewed using these 12 cytological features to predict the outcome. Results: Out of 12 cytological features evaluated in phase 1 (training set), nuclear chromatin pattern, apoptotic bodies and tingible body macrophages were found to be the most significant features determining malignant histological outcome. These 12 cytological features were re-evaluated in phase 2 (n = 125). Of 125 cases, 54 had a benign and 71 had a malignant or premalignant histological outcome, with a positive predictive value of 56.8%. Conclusion: Granular nuclear chromatin, tingible body macrophages and apoptosis in the background are the most significant factors in determining whether endometrial cells present in cervical samples represent malignancy or are benign. Using these features, relatively accurate predictions of endometrial pathology can be made.

scholarly journals Psychometric Properties of the MyotonPRO in Dementia Patients with Paratonia

Gerontology ◽  
2017 ◽  
Vol 64 (4) ◽  
pp. 401-412 ◽  
Author(s):  
Hans Drenth ◽  
Sytse U. Zuidema ◽  
Wim P. Krijnen ◽  
Ivan Bautmans ◽  
Cees van der Schans ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Correlation Coefficient ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Functional Mobility ◽  
Future Research ◽  
Minimal Detectable Change ◽  
Muscle Properties ◽  
Dementia Patients ◽  
Longitudinal Outcome

Background: Paratonia is a distinctive form of hypertonia, causing loss of functional mobility in early stages of dementia to severe high muscle tone and pain in the late stages. For assessing and evaluating therapeutic interventions, objective instruments are required. Objective: Determine the psychometric properties of the MyotonPRO, a portable device that objectively measures muscle properties, in dementia patients with paratonia. Methods: Muscle properties were assessed with the MyotonPRO by 2 assessors within one session and repeated by the main researcher after 30 min and again after 6 months. Receiver operating characteristic curves were constructed for all MyotonPRO outcomes to discriminate between participants with (n = 70) and without paratonia (n = 82). In the participants with paratonia, correlation coefficients were established between the MyotonPRO outcomes and the Modified Ashworth Scale for paratonia (MAS-P) and muscle palpation. In participants with paratonia, reliability (intraclass correlation coefficient) and agreement values (standard error of measurement and minimal detectable change) were established. Longitudinal outcome from participants with paratonia throughout the study (n = 48) was used to establish the sensitivity for change (correlation coefficient) and responsiveness (minimal clinical important difference). Results: Included were 152 participants with dementia (mean [standard deviation] age of 83.5 [98.2]). The area under the curve ranged from 0.60 to 0.67 indicating the MyotonPRO is able to differentiate between participants with and without paratonia. The MyotonPRO explained 10-18% of the MAS-P score and 8-14% of the palpation score. Interclass correlation coefficients for interrater reliability ranged from 0.57 to 0.75 and from 0.54 to 0.71 for intrarater. The best agreement values were found for tone, elasticity, and stiffness. The change between baseline and 6 months in the MyotonPRO outcomes explained 8-13% of the change in the MAS-P scores. The minimal clinically important difference values were all smaller than the measurement error. Conclusion: The MyotonPRO is potentially applicable for cross-sectional studies between groups of paratonia patients and appears less suitable to measure intraindividual changes in paratonia. Because of the inherent variability in movement resistance in paratonia, the outcomes from the MyotonPRO should be interpreted with care; therefore, future research should focus on additional guidelines to increase the clinical interpretation and improving reproducibility.

Sign in / Sign up

Export Citation Format

Share Document