scholarly journals The Diversity Site Assessment Tool (DSAT), Reliability and Validity of the Industry Gold Standard for Establishing Investigator Site Ranking

2020 ◽  
Vol 7 ◽  
Author(s):  
Diana Foster
Keyword(s):  
Clinical Trials ◽  
Best Practices ◽  
Construct Validity ◽  
Assessment Tool ◽  
Internal Consistency Reliability ◽  
Self Report ◽  
Self Assessment ◽  
Site Assessment ◽  
Site Characteristics ◽  
Diverse Patient Populations

Background: The purpose of this study was to evaluate the reliability and construct validity of the Diversity Site Assessment Tool (DSAT), a self-assessment instrument designed to self-report the extent to which best practices related to recruitment of diverse patient populations during clinical trials are used. Methods: A cross-sectional design was used. The convenience sample consisted of site representatives who are members of the Society for Clinical Research Sites and network site representatives that were approached via social media sites such as LinkedIn. A link to the survey was shared with approximately 17,000 aforementioned site representatives over a period of three months. The survey consisted of one section each for the indicators of best practice for the recruitment of diverse patient populations during clinical trials: 1) Site Overview (10 items), 2) Site Recruitment and Outreach (9 items) and 3) Patient Focused Services (6 items). These three indicators and the total of 25 items make up the DSAT. Each of the total 25 items on DSAT required participants to self-report on a 6-point scale. The fourth section collected background information about the participant and their site. After the survey was closed, two types of summative scores were compiled, one for each of the indicators and an overall summative DSAT score (range from 25-150). Higher summative scores on each indicator and the overall DSAT are reflective of increased use of best practices for the recruitment of diverse patient population during clinical trials. Internal consistency reliability (Cronbach’s alpha) and construct validity for the entire sample were evaluated and are reported. Bivariate and multivariate statistics were conducted to examine the relationship between site characteristics and their summative indicator and DSAT overall scores. Results: The instrument was deemed to have exceptional reliability. Cronbach's alpha coefficient for internal consistency reliability for the entire sample was 0.929. Construct validity established using the exploratory factor analysis indicated a three component solution accounting for 49% of the explained variance. There was no statistically relationship between site characteristics and their summative indicator and DSAT overall scores.   Conclusion: The DSAT has exceptional reliability and good construct validity. When paired with the findings that site characteristics have no statistical relationship with the DSAT indicators and overall summative scores, it is contended that this instrument could be used by different site backgrounds as a self-assessment measure to evaluate the extent of the use of best practices related to recruitment of diverse patient populations during clinical trials. The rigorous development of the instrument and exceptional statistical results make the tool easily the highest standard of measurement available related to this construct.

Using the ASHP Best Practices Self-Assessment Tool

2004 ◽  
Vol 61 (6) ◽  
pp. 562-563 ◽  
Author(s):  
Steven P. Nelson ◽  
Paul W. Abramowitz
Keyword(s):  
Best Practices ◽  
Assessment Tool ◽  
Self Assessment

scholarly journals What can we learn from randomized clinical trials about the construct validity of self-report measures of mindfulness? A meta-analysis

2019 ◽  
Author(s):  
Simon Goldberg ◽  
Raymond P. Tucker ◽  
Preston A. Greene ◽  
Tracy L. Simpson ◽  
William T. Hoyt ◽  
...  
Keyword(s):  
Clinical Trials ◽  
Construct Validity ◽  
Clinical Outcomes ◽  
Randomized Clinical Trials ◽  
Experimental Manipulation ◽  
Post Treatment ◽  
Self Report ◽  
Treatment Comparison ◽  
Bona Fide

Because they provide data on responsiveness to experimental manipulation, clinical trials involving mindfulness-based inter- ventions are a source of evidence for the construct validity of self-report measures of mindfulness. Within-group and between- group changes in mindfulness were examined from randomized clinical trials comparing mindfulness interventions to other bona fide treatment comparison conditions or waitlist control conditions. We also examined changes in clinical outcomes and the magnitude of these changes relative to changes in mindfulness. We included 69 published studies representing 55 unique samples (n = 4743). Self-report mindfulness measures showed relatively larger gains in mindfulness intervention conditions vis-à-vis waitlist comparison conditions at both post-treatment (effect size [ES] = 0.52, 95% CI [0.40, 0.64]) and follow-up (ES = 0.52 [0.20, 0.84]), although the effect at follow-up diminished to non-significance in a trim-and-fill analysis intended to account for publication bias (ES = 0.35 [− 0.03, 0.72]). Measures of mindfulness also showed relatively larger gains in mindfulness inter- vention conditions vis-à-vis bona fide comparison conditions, but only at post-treatment (ES = 0.25 [0.11, 0.38], 0.10 [− 0.08, 0.28], at post-treatment and follow-up, respectively). All three conditions (mindfulness, bona fide, waitlist) showed relatively larger improvements on measures of clinical outcomes than measures of mindfulness, with the exception of waitlist conditions for which this effect was no longer significant at follow-up. Taken together, findings provide partial support for the unique respon- siveness of mindfulness self-report measures to interventions that include promotion of mindfulness meditation practice.

scholarly journals A Holistic Cybersecurity Maturity Assessment Framework for Higher Education Institutions in the United Kingdom

2020 ◽  
Vol 10 (10) ◽  
pp. 3660
Author(s):  
Aliyu Aliyu ◽  
Leandros Maglaras ◽  
Ying He ◽  
Iryna Yevseyeva ◽  
Eerke Boiten ◽  
...  
Keyword(s):  
Higher Education ◽  
United Kingdom ◽  
Best Practices ◽  
Assessment Tool ◽  
Assessment Framework ◽  
Self Assessment ◽  
Maturity Models ◽  
Capability Maturity ◽  
The United Kingdom ◽  
Maturity Assessment

As organisations are vulnerable to cyberattacks, their protection becomes a significant issue. Capability Maturity Models can enable organisations to benchmark current maturity levels against best practices. Although many maturity models have been already proposed in the literature, a need for models that integrate several regulations exists. This article presents a light, web-based model that can be used as a cybersecurity assessment tool for Higher Education Institutes (HEIs) of the United Kingdom. The novel Holistic Cybersecurity Maturity Assessment Framework incorporates all security regulations, privacy regulations, and best practices that HEIs must be compliant to, and can be used as a self assessment or a cybersecurity audit tool.

The Hostile Interpretations Questionnaire

2000 ◽  
Vol 27 (5) ◽  
pp. 645-663 ◽  
Author(s):  
DAVID J. SIMOURD ◽  
JOELLE M. MAMUZA
Keyword(s):  
Construct Validity ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Psychological Assessment ◽  
Internal Consistency Reliability ◽  
Violent Offenders ◽  
Theory And Practice ◽  
Self Report ◽  
Psychometric Measures ◽  
Acceptable Internal Consistency

This study explored the psychometric properties and construct validity of a new measure of hostility, the Hostile Interpretations Questionnaire (HIQ). The sample consisted of 146 violent offenders incarcerated in a Canadian federal institution. Participants completed a battery of self-report psychometric measures as part of a pre-release psychological assessment. Results indicated that the HIQ had acceptable internal consistency reliability ( r = .86) and demonstrated construct validity with relevant anger/hostility measures. Implications of the findings with respect to theory and practice are considered.

The Stressors of Clergy Children and Couples: Reliability and Validity

1993 ◽  
Vol 72 (1) ◽  
pp. 271-275 ◽  
Author(s):  
Diane L. Ostrander ◽  
Cindi Penor Ceglian ◽  
David G. Fournier
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Family Members ◽  
Reliability And Validity ◽  
Internal Consistency Reliability ◽  
Self Report ◽  
Clergy Children ◽  
Research Recommendations

The purpose of this study was to evaluate the Stressors of Clergy Children and Couples Scale, an abbreviated version of the Stressors of Clergy Children Inventory. The current self-report survey was tested using 317 ministers' family members across several denominations. Tests for internal consistency reliability and construct validity indicated this scale was adequate for use in research. Recommendations for refinement and use of the scale were presented.

Validity and reliability of the MSQ LI in cognitively impaired patients with multiple sclerosis

2003 ◽  
Vol 9 (6) ◽  
pp. 621-626 ◽  
Author(s):  
Ruth Ann Marrie ◽  
Deborah M Miller ◽  
Gordon J Chelune ◽  
Jeffrey A Cohen
Keyword(s):  
Quality Of Life ◽  
Multiple Sclerosis ◽  
Cognitive Impairment ◽  
Construct Validity ◽  
Internal Consistency ◽  
Internal Consistency Reliability ◽  
Self Report ◽  
Cognitively Impaired ◽  
Validity And Reliability

Multiple sclerosis (MS) has important effects on quality of life but it is unknown how cognitive impairment affects the ability to assess or report this. O ur objective was to determine whether cognitive impairment negatively affects the construct validity and the reliability of the Multiple Sclerosis Q uality of Life Inventory (MSQLI). A neuropsychological test batter y and the Multiple Sclerosis Functional C omposite (MSFC) were administered to a sample of 136 patients referred for cognitive testing by their neurologists. A ge, sex, educatio n and ethnicity-adjusted T scores were calculated for each cognitive variable. C ognitive impairment was defined as any T score less than the fifth percentile. The MSQ LI was administered prior to neuropsychological testing and readministered one to four weeks later. C orrelations between the MSFC and the SF-36 were determined and compared between the cognitively impaired and unimpaired groups as the main test of construct validity. Test -retest and internal consistency reliability of each of the scales were compared for the impaired and unimpaired groups. Seventy-six (56%) patients were cognitively impaired. C onstruct validity and internal consistency reliability did not differ between the cognitively impaired and unimpaired groups. Test -retest reliability was lower for the bladder and vision scales in the impaired group, but remained acceptable for the bladder scale (r >0.7). C ognitive impairment, a common MS manifestation, does not appear to reduce the reliability or validity of the MSQ LI as a patient self-report measure of health status and quality of life.

scholarly journals Capacity Assessment Training and Competency Evaluation Tool

2020 ◽  
Vol 4 (Supplement_1) ◽  
pp. 595-595
Author(s):  
Lindsey Jacobs ◽  
Patricia Bamonti ◽  
Jessica Strong ◽  
Kyle Page ◽  
Barry Edelstein ◽  
...  
Keyword(s):  
Older Adults ◽  
Assessment Tool ◽  
Self Report ◽  
Capacity Assessment ◽  
Evaluation Tool ◽  
Self Assessment ◽  
Capacity Evaluation ◽  
Decision Making Capacity ◽  
Assessment Training ◽  
Competency Evaluation

Abstract Given the complex interplay of ethical, clinical, and legal factors, evaluating capacities in older adults is an important competency for geropsychologists. However, the amount of quality of training in this area varies, and geropsychology trainees report less confidence in their capacity evaluation skills. To date, only the Pikes Peak Self-Assessment Tool includes items measuring competency and growth in decisional capacity evaluations. However, it is a broad self-report measure assessing general geropsychology competencies. We developed a performance-based measure of decision-making capacity evaluations, the “Capacity Assessment Training and Competency Evaluation Tool (CATCET).” Using the ABA/APA Assessment of Older Adults with Diminished Capacity as a guide, expert panels created two clinical cases across 5 capacity domains. This presentation will discuss the creation of the CATCET, its application as a training and evaluation tool, and initial performance data among psychology graduate students, intern, and fellows across settings.

scholarly journals Development and cross-cultural testing of the International Depression Symptom Scale (IDSS): a measurement instrument designed to represent global presentations of depression

2017 ◽  
Vol 4 ◽  
Author(s):  
E. E. Haroz ◽  
J. Bass ◽  
C. Lee ◽  
S. S. Oo ◽  
K. Lin ◽  
...  
Keyword(s):  
Suicidal Ideation ◽  
Construct Validity ◽  
Internal Consistency ◽  
Internal Consistency Reliability ◽  
Criterion Validity ◽  
Self Report ◽  
Depression Symptom ◽  
Symptom Scale ◽  
Retest Reliability ◽  
Test Retest Reliability

BackgroundSelf-report measurement instruments are commonly used to screen for mental health disorders in Low and Middle-Income Countries (LMIC). The Western origins of most depression instruments may constitute a bias when used globally. Western measures based on the DSM, do not fully capture the expression of depression globally. We developed a self-report scale design to address this limitation, the International Depression Symptom Scale-General version (IDSS-G), based on empirical evidence of the signs and symptoms of depression reported across cultures. This paper describes the rationale and process of its development and the results of an initial test among a non-Western population.MethodsWe evaluated internal consistency reliability, test–retest reliability and inter-rater reliability of the IDSS-G in a sample N = 147 male and female attendees of primary health clinics in Yangon, Myanmar. For criterion validity, IDSS-G scores were compared with diagnosis by local psychiatrists using the Structured Clinical Interview for DSM (SCID). Construct validity was evaluated by investigating associations between the IDSS-G and the Patient Health Questionnaire (PHQ), impaired function, and suicidal ideation.ResultsThe IDSS-G showed high internal consistency reliability (α = 0.92), test–retest reliability (r = 0.87), and inter-rater reliability (ICC = 0.90). Strong correlations between the IDSS-G and PHQ-9, functioning, and suicidal ideation supported construct validity. Criterion validity was supported for use of the IDSS-G to identify people with a SCID diagnosed depressive disorder (major depression/dysthymia). The IDSS-G also demonstrated incremental validity by predicting functional impairment beyond that predicted by the PHQ-9. Results suggest that the IDSS-G accurately assesses depression in this population. Future testing in other populations will follow.

scholarly journals Self-Reported Antimicrobial Stewardship Practices in Primary Care Using the TARGET Antibiotics Self-Assessment Tool

Antibiotics ◽  
2020 ◽  
Vol 9 (5) ◽  
pp. 253
Author(s):  
Leah Ffion Jones ◽  
Neville Quinton Verlander ◽  
Donna Marie Lecky ◽  
Sabeen Altaf ◽  
Dirk Pilat ◽  
...  
Keyword(s):  
Primary Care ◽  
Antimicrobial Stewardship ◽  
Assessment Tool ◽  
Self Report ◽  
Antibiotic Prescribing ◽  
Clinical Coding ◽  
Self Assessment ◽  
Microsoft Excel ◽  
Information Leaflets ◽  
Primary Care Clinicians

The self-assessment tool (SAT) is a 16-question self-report of antimicrobial stewardship practices in primary care, available in the TARGET (Treat Antibiotics Responsibly, Guidance Education and Tools) Antibiotics Toolkit. This study analysed responses to the SAT and compared them to previous SAT data (2014–2016). Data from June 2016 to September 2019 were anonymised and analysed using Microsoft Excel and STATA 15. Clinicians reported engaging in positive antimicrobial stewardship (AMS) practices including using antibiotic guidance to inform treatment decisions (98%, 98% 2014–2016), discussing antibiotic prescribing within the practice (73%, 67% 2014–2016), using patient-facing resources (94%, 71% 2014–2016), conducting antibiotic audits in the last two years (98%, 45% 2014–2016), keeping written records and action plans (81%, 62% 2014–2016), using back-up prescribing (99%, 94% 2014–2016) and using clinical coding (80%, 75% 2014–2016). Areas for improvement include developing strategies to avoid patients reconsulting to obtain antibiotics (45%, 33% 2014–2016), undertaking infection-related learning (37%, 29% 2014–2016), ensuring all temporary prescribers have access to antibiotic guidance (55%, 63% 2014–2016) and making patient information leaflets easily available during consultations (31%). The findings offer a unique insight into AMS in primary care over time. The SAT gives primary care clinicians and commissioners an opportunity to reflect on their AMS and learning.

Sign in / Sign up

Export Citation Format

Share Document