scholarly journals Does the choice of response time threshold procedure substantially affect inferences concerning the identification and exclusion of rapid guessing responses? A meta-analysis

2021 ◽  
Vol 9 (1) ◽  
Author(s):  
Joseph A. Rios ◽  
Jiayi Deng
Keyword(s):  
Response Time ◽  
Empirical Data ◽  
Test Performance ◽  
Meta Analysis ◽  
Performance Outcomes ◽  
Measurement Properties ◽  
Individual Level ◽  
Group Score ◽  
Time Threshold ◽  
Threshold Procedure

Abstract Background In testing contexts that are predominately concerned with power, rapid guessing (RG) has the potential to undermine the validity of inferences made from educational assessments, as such responses are unreflective of the knowledge, skills, and abilities assessed. Given this concern, practitioners/researchers have utilized a multitude of response time threshold procedures that classify RG responses in these contexts based on either the use of no empirical data (e.g., an arbitrary time limit), response time distributions, and the combination of response time and accuracy information. As there is little understanding of how these procedures compare to each other, this meta-analysis sought to investigate whether threshold typology is related to differences in descriptive, measurement property, and performance outcomes in these contexts. Methods Studies were sampled that: (a) employed two or more response time (RT) threshold procedures to identify and exclude RG responses on the same computer-administered low-stakes power test; and (b) evaluated differences between procedures on the proportion of RG responses and responders, measurement properties, and test performance. Results Based on as many as 86 effect sizes, our findings indicated non-negligible differences between RT threshold procedures in the proportion of RG responses and responders. The largest differences for these outcomes were observed between procedures using no empirical data and those relying on response time and accuracy information. However, these differences were not related to variability in aggregate-level measurement properties and test performance. Conclusions When filtering RG responses to improve inferences concerning item properties and group score outcomes, the actual threshold procedure chosen may be of less importance than the act of identifying such deleterious responses. However, given the conservative nature of RT thresholds that use no empirical data, practitioners may look to avoid the use of these procedures when making inferences at the individual-level, given their potential for underclassifying RG.

scholarly journals Positron emission tomography (PET) for prediction of glioma histology: protocol for an individual-level data meta-analysis of test performance

BMJ Open ◽  
2018 ◽  
Vol 8 (2) ◽  
pp. e020187 ◽  
Author(s):  
Nikolaos A Trikalinos ◽  
Takashi Nihashi ◽  
Evangelos Evangelou ◽  
Teruhiko Terasawa
Keyword(s):  
Positron Emission Tomography ◽  
Test Performance ◽  
Meta Analysis ◽  
Clinical Trial Design ◽  
Emission Tomography ◽  
Low Grade ◽  
Individual Level ◽  
Positron Emission ◽  
Level Data ◽  
Study Results

IntroductionGliomas, the most commonly diagnosed primary brain tumours, are associated with varied survivals based, in part, on their histological subtype. Therefore, accurate pretreatment tumour grading is essential for patient care and clinical trial design.Methods and analysisWe will perform an individual-level data meta-analysis of published studies to evaluate the ability of different types of positron emission tomography (PET) to differentiate high from low-grade gliomas. We will search PubMed and Scopus from inception through 30 July 2017 with no language restriction and full-text evaluation of potentially relevant articles. We will choose studies that assess PET using 18-Fludeoxyglucose (18F-FDG), l-[Methyl-()11C]Methionine (11C-MET), 18F-Fluoro-Ethyl-Tyrosine (18F-FET) or (18)F-Fluorothymidine (18F-FLT)for grading, verified with histological confirmation. We will include both prospective and retrospective studies. Bias will be assessed by two reviewers with the Quality Assessment of Diagnostic Accuracy Studies-2 tool and as per method described by Deeks et al.Ethics and disseminationEthics approval was not applicable, as this is a meta-analytic study. Results of the analysis will be submitted for publication in a peer-reviewed journal.PROSPERO registration numberCRD42017078649.

scholarly journals Employee Responses to Empowering Leadership: A Meta-Analysis

2018 ◽  
Vol 25 (3) ◽  
pp. 257-276 ◽  
Author(s):  
Minseo Kim ◽  
Terry A. Beehr ◽  
Matthew S. Prewett
Keyword(s):  
Meta Analysis ◽  
Organizational Outcomes ◽  
Employee Motivation ◽  
Performance Outcomes ◽  
Empowering Leadership ◽  
Individual Level ◽  
And Performance ◽  
The Individual ◽  
Relationship Of ◽  
Employee Responses

A recent and growing number of studies examined how empowering leadership influences employee outcomes. At the individual level, we meta-analyzed 55 independent samples to determine the association between empowering leader behaviors and subordinates’ responses. Results confirmed the positive links of empowering leadership with evaluations of the leader as well as with employee motivation and resources, attitudes, and performance; the strongest correlation was between empowering leadership and attitudes toward the leader (ρ = .59), whereas the weakest correlation was for empowering leadership with behavioral and performance outcomes (ρ = .31). However, the relationship of empowering leadership with subordinates’ emotions was not significant. Examination of potential moderators, including rating sources, nationality of sample, gender, and industry, did not explain much of the heterogeneity in the results. In sum, findings highlight the potential benefit of empowering leadership for individual and organizational outcomes. Thus, more knowledge about what causes empowering leadership could be useful.

Third Party Observers and Neuropsychological Test Performance: A Meta-Analysis

2010 ◽  
Author(s):  
Angela D. Eastvold ◽  
Pamela M. Dean ◽  
Heather Belanger ◽  
Rodney D. Vanderploeg
Keyword(s):  
Test Performance ◽  
Meta Analysis ◽  
Neuropsychological Test ◽  
Third Party

scholarly journals “The Dichotic Digit Test” as an Index Indicator for Hearing Problem in Dementia: Systematic Review and Meta-Analysis

2020 ◽  
Author(s):  
Nattawan Utoomprurkporn ◽  
Chris J.D. Hardy ◽  
Joshua Stott ◽  
Sergi G. Costafreda ◽  
Jason Warren ◽  
...  
Keyword(s):  
Systematic Review ◽  
Cognitive Impairment ◽  
Speech Processing ◽  
Test Performance ◽  
Meta Analysis ◽  
Control Group ◽  
People With Dementia ◽  
Ear Advantage ◽  
Right Ear Advantage ◽  
Dementia Onset

Abstract Background Patients with dementia commonly have problems processing speech in the presence of competing background speech or noise. This difficulty can be present from the very early stages of dementia, and may be a preclinical feature of Alzheimer's disease. Purpose This study investigates whether people with dementia perform worse on the dichotic digit test (DDT), an experimental probe of speech processing in the presence of competing speech, and whether test performance may predict dementia onset. Research Design Systematic review and meta-analysis. Data Collection and Analysis A literature search was conducted in Medline, Embase, Scopus, and Psycinfo. We included (1) studies that included people with a diagnosis of dementia and a healthy control group with no cognitive impairment; (2) studies that reported results from a DDT in a free-recall response task; and (3) studies that had the dichotic digit mean correct percentage score or right-ear advantage, as outcome measurements. Results People with dementia had a lower DDT total score, with a pooled mean difference of 18.6% (95% confidence interval [CI]: 21.2–15.9). Patients with dementia had an increased right-ear advantage relative to controls with a pooled difference of 24.4% (95% CI: 21.8–27.0). Conclusion The DDT total scores are lower and the right-ear advantage increased in cognitively impaired versus normal control participants. The findings also suggest that the reduction of dichotic digit total score and increase of right-ear advantage progress as cognitive impairment increases. Whether abnormalities in dichotic digit scores could predict subsequent dementia onset should be examined in further longitudinal studies.

Alliance experience and performance outcomes: A meta-analysis

2021 ◽  
pp. 147612702098287
Author(s):  
Peng Wang ◽  
Xu Jiang ◽  
Maggie Chuoyan Dong
Keyword(s):  
Strategic Alliance ◽  
Meta Analysis ◽  
Group Analysis ◽  
Performance Outcomes ◽  
Country Level ◽  
Different Types ◽  
Performance Consequences ◽  
Controversial Topic ◽  
Alliance Experience ◽  
And Performance

Alliance experience has been a frequent topic in strategic alliance research in recent decades. Nonetheless, its performance consequences, either as a whole or differentiated into general versus partner-specific alliance experience, are neither theoretically clear nor empirically consistent. We use a range of meta-analytic techniques to integrate the empirical findings of 143 studies and provide a more conclusive assessment compared to prior research. Our study thus addresses a long-standing, understudied, and controversial topic: the distinction between the two types of alliance experiences. Going beyond traditional sub-group analysis, we reveal the contextual contingencies by examining how different types of alliance experiences and performance outcomes jointly affect the alliance experience–performance relationship. Moreover, we identify critical country-level institutional contingencies that moderate the focal effect.

scholarly journals The diagnostic value of EBV-DNA and EBV-related antibodies detection for nasopharyngeal carcinoma: a meta-analysis

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Weixing Liu ◽  
Gui Chen ◽  
Xin Gong ◽  
Yingqi Wang ◽  
Yaoming Zheng ◽  
...  
Keyword(s):  
Nasopharyngeal Carcinoma ◽  
Test Performance ◽  
Meta Analysis ◽  
Diagnostic Value ◽  
Cochrane Library ◽  
Control Group ◽  
Summary Receiver Operating Characteristic ◽  
Ebv Dna ◽  
The Difference ◽  
Sensitivity Specificity

Abstract Background Numerous individual studies have investigated the diagnostic value of EBV-DNA, EA-IgA, VCA-IgA, EBNA1-IgA and Rta-IgG detection for nasopharyngeal carcinoma (NPC), but the conclusions remain controversial. This meta-analysis aimed to determine the value of EBV-DNA, EA-IgA, VCA-IgA, EBNA1-IgA and Rta-IgG detection in the diagnosis of NPC. Methods PROSPERO registration number: CRD42019145532. PubMed, EMBASE, Cochrane Library, and Chinese data libraries (Wanfang, CNKI, and CBM) were searched up to January 2019. The pooled sensitivity, specificity, and positive likelihood, negative likelihood, and diagnostic odds ratios were conducted in this meta-analysis. Summary receiver operating characteristic curves evaluated the test-performance global summary. Publication bias was examined by Deek’s funnel plot asymmetry test. Results Forty-seven studies with 8382 NPC patients (NPC group) and 15,089 individuals without NPC (Control group) were included in this meta-analysis. The sensitivity, specificity, positive likelihood (+ LR), negative likelihood (-LR), DOR and AUC of EBV-DNA in diagnosis of NPC were: 0.76 (95% CI 0.73–0.77), 0.96 (95% CI 0.95–0.97), 14.66 (95% CI 9.97–21.55), 0.19 (95% CI 0.13–0.28), 84 (95% CI 50.45–139.88), 0.96 (SE: 0.001), and 0.55 (95% CI 0.54–0.57), 0.96 (95% CI 0.96–0.97), 12.91 (95% CI 9.55–17.45), 0.35 (95% CI 0.29–0.43), 39.57 (95% CI 26.44–59.23), 0.94 (SE: 0.002) for the EA-IgA, and 0.85 (95% CI 0.84–0.85), 0.89 (95% CI 0.88–0.89), 6.73 (95% CI5.38–8.43), 0.17 (95% CI 0.12–0.23), 43.03 (95% CI 31.51–58.76), 0.93 (SE: 0.007) for the VCA-IgA, and 0.86 (95% CI 0.85–0.88), 0.87 (95% CI 0.88–0.90), 7.55 (95% CI 5.79–9.87), 0.16 (95% CI 0.13–0.19), 50.95 (95% CI 34.35–75.57), 0.94 (SE: 0.008) for the EBNA1-IgA, and 0.70 (95% CI 0.69–0.71), 0.94 (95% CI 0.94–0.95), 9.84 (95% CI 8.40–11.54), 0.25 (95% CI 0.21–0.31), 40.59 (95% CI 32.09–51.35), 0.95 (SE: 0.005) for the Rta-IgG. The EBV-DNA had larger AUC compared with other EBV-based antibodies (P < 0.05), while the difference between EA-IgA, VCA-IgA, EBNA1-IgA and Rta-IgG was not statistically significant (P > 0.05). Conclusions EBV-DNA, VCA-IgA, EBNA1-IgA and Rta-IgG detection have high accuracy in early diagnosis NPC. In addition, EBV-DNA detection has the higher diagnosis accuracy in NPC. On the other hand, EA-IgA is suitable for the diagnosis but not NPC screening.

Macro-level Criminological Perspectives and School Delinquency: A Meta-analysis

2021 ◽  
pp. 0044118X2110223
Author(s):  
Natasha Pusch
Keyword(s):  
Social Cohesion ◽  
Meta Analysis ◽  
School Level ◽  
Effect Sizes ◽  
Macro Level ◽  
Future Research ◽  
Concentrated Disadvantage ◽  
Individual Level ◽  
School Differences ◽  
Academic Implications

School delinquency in public elementary, middle, and high schools has decreased in recent years, but is still a major issue that has negative mental health and academic implications for adolescents. Although research has focused on both individual-level and school-level explanations of school delinquency, it is not yet clear which macro-level criminological perspectives best explains it. Using 656 effect sizes nested within 75 studies and 30 unique datasets, this study addresses two questions using meta-analytic methods: Which macro-level criminological perspectives explain between-school differences in delinquency? Are effect sizes invariant across samples and research design? Results indicate that only concentrated disadvantage and social cohesion are significantly related to school delinquency. With the exception of concentrated disadvantage, effects are homogenous. This suggests that some school-level explanations are useful and future research should not exclude these factors. Practical implications suggest that improving social cohesion in schools may be more effective at preventing violence than target-hardening efforts.

scholarly journals Role of nurses to improve self-care in heart failure patients: a systematic review and meta-analysis

2019 ◽  
Vol 29 (Supplement_4) ◽  
Author(s):  
A Massimi ◽  
C De Vito ◽  
M L Rega ◽  
P Villari ◽  
G Damiani
Keyword(s):  
Heart Failure ◽  
Systematic Review ◽  
Meta Analysis ◽  
Self Care ◽  
Educational Interventions ◽  
Management Skills ◽  
Short Term ◽  
Post Discharge ◽  
Individual Level ◽  
Heart Failure Patients

Abstract Introduction Heart Failure (HF) is a pandemic chronic disease with a prevalence up to 3% in the general population, representing the main cause of hospitalization for people over 65. Self-care plays a central role in the management of patients with HF, showing evidence of effectiveness in reducing re-hospitalization rates and mortality. Methods We carried out a systematic review and meta-analysis to assess the efficacy of nurse-led educational interventions Vs usual care in improving self-care skills of patients with chronic HF. The main biomedical databases were searched for Randomized Control Trials (RCTs) of nurse-led educational interventions performed on adults with a previous diagnosis of HF. Improvement of HF self-management skills (self-care level) was summarized by calculating the standardized mean difference (SMD) and 95% confidence intervals (CI) stratified for the length of the follow-up. Results Globally, 14 RCTs were included involving 2078 participants. Ten studies showed the efficacy of the interventions at 3 months (short term) with a SMD of 0.78 (95% CI 0.38-1.18) in favor of the self-care education interventions. Five studies reported on self-care abilities at 6-9 months (medium term), not showing statistically significant results (SMD 0.35, 95%CI 0.11-0.81). The long-term effect of the educational interventions showed no statistically significant improvement in self-care behaviors (three studies, SMD 0.05, 95CI% 0.12 - 0.22). Conclusions These results show that nursing educational interventions improve self-care behaviors in HF, but mainly in the short term. Intensive educational interventions led by nurses, associated with appropriate continuity and transition of care, can determine the best outcomes for patients with HF, strengthening self-care behaviors over time. This approach could have a major impact not only on individual level, but on the general reduction of complications, hospitalization, medical costs and ultimately mortality. Key messages Nurse-led educational programs have a short-term efficacy in enhancing self-care behaviors among heart failure patients. Post-discharge repeated educational interventions, along with timely and shared plans ruling the transition between the hospital and the other providers, are strongly needed.

Sign in / Sign up

Export Citation Format

Share Document