scholarly journals A Meta-Analysis of Test Scores in Proctored and Unproctored Ability Assessments

2018 ◽  
Author(s):  
Diana Steger ◽  
Ulrich Schroeders ◽  
Timo Gnambs
Keyword(s):  
Context Effects ◽  
Rank Order ◽  
Meta Analysis ◽  
Effect Sizes ◽  
The Internet ◽  
Web Based ◽  
Total N ◽  
Test Taking ◽  
Personal Consequences ◽  
Mean Differences

Unproctored, web-based assessments are frequently compromised by a lack of control over the participants’ test taking behavior. It is likely that participants cheat if personal consequences are high. This meta-analysis summarizes findings on context effects in unproctored and proctored ability assessments and examines mean score differences and correlations between both assessment contexts. As potential moderators, we consider (a) the perceived consequences of the assessment, (b) countermeasures against cheating, (c) the susceptibility to cheating of the measure itself, and (d) the use of different test media. For standardized mean differences, a three-level random-effects meta-analysis based on 108 effect sizes from 49 studies (total N = 100,434) identified a pooled effect of Δ = 0.20, 95% CI [0.10, 0.31], indicating higher scores in unproctored assessments. Moderator analyses revealed significantly smaller effects for measures that are difficult to research on the Internet. Regarding rank order stability, a small subsample of studies (n = 5) providing 15 effect sizes (total N = 1,280) indicated considerable rank order changes (ρ = .58, 95% CI [.38, .78]). These results demonstrate that unproctored ability assessments are markedly biased by cheating. Unproctored assessments may be most suitable for tasks that are difficult to search on the Internet.

scholarly journals A Meta-Analysis of Test Scores in Proctored and Unproctored Ability Assessments

2020 ◽  
Vol 36 (1) ◽  
pp. 174-184 ◽  
Author(s):  
Diana Steger ◽  
Ulrich Schroeders ◽  
Timo Gnambs
Keyword(s):  
Context Effects ◽  
Meta Analysis ◽  
Effect Sizes ◽  
The Internet ◽  
Web Based ◽  
Total N ◽  
Test Taking ◽  
Lack Of Control ◽  
Personal Consequences ◽  
Mean Differences

Abstract. Unproctored, web-based assessments are frequently compromised by a lack of control over the participants’ test-taking behavior. It is likely that participants cheat if personal consequences are high. This meta-analysis summarizes findings on context effects in unproctored and proctored ability assessments and examines mean score differences and correlations between both assessment contexts. As potential moderators, we consider (a) the perceived consequences of the assessment, (b) countermeasures against cheating, (c) the susceptibility to cheating of the measure itself, and (d) the use of different test media. For standardized mean differences, a three-level random-effects meta-analysis based on 109 effect sizes from 49 studies (total N = 100,434) identified a pooled effect of Δ = 0.20, 95% CI [0.10, 0.31], indicating higher scores in unproctored assessments. Moderator analyses revealed significantly smaller effects for measures that are difficult to research on the Internet. These results demonstrate that unproctored ability assessments are biased by cheating. Unproctored assessments may be most suitable for tasks that are difficult to search on the Internet.

Astrocyte Biomarkers in Alzheimer Disease: A Systematic Review and Meta-analysis

Neurology ◽  
2021 ◽  
pp. 10.1212/WNL.0000000000012109
Author(s):  
Bruna Bellaver ◽  
João Pedro Ferrari-Souza ◽  
Lucas Uglione da Ros ◽  
Stephen F Carter ◽  
Elena Rodriguez-Vieitez ◽  
...  
Keyword(s):  
Systematic Review ◽  
Web Of Science ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Significant Progress ◽  
Exclusion Criteria ◽  
Mao B ◽  
Positron Emission ◽  
Registration Number ◽  
Mean Differences

Objective:To perform a systematic review and meta-analysis to determine whether fluid and imaging astrocyte biomarkers are altered in Alzheimer's disease (AD).Methods:PubMed and Web of Science databases were searched for articles reporting fluid or imaging astrocyte biomarkers in AD. Pooled effect sizes were determined with mean differences (SMD) using the Hedge’s G method with random-effects to determine biomarker performance. Adapted questions from QUADAS-2 were applied for quality assessment. A protocol for this study has been previously registered in PROSPERO (registration number: CRD42020192304).Results:The initial search identified 1,425 articles. After exclusion criteria were applied, 33 articles (a total of 3,204 individuals) measuring levels of GFAP, S100B, YKL-40 and AQP4 in the blood and cerebrospinal fluid (CSF), as well as MAO-B, indexed by positron emission tomography 11C-deuterium-L-deprenyl ([11C]-DED), were included. GFAP (SMD = 0.94; 95% CI = 0.71-1.18) and YKL-40 (SMD = 0.76; CI 95% = 0.63-0.89) levels in the CSF, S100B levels in the blood (SMD = 2.91; CI 95% = 1.01-4.8) were found significantly increased in AD patients.Conclusions:Despite significant progress, applications of astrocyte biomarkers in AD remain in their early days. The meta-analysis demonstrated that astrocyte biomarkers are consistently altered in AD and supports further investigation for their inclusion in the AD clinical research framework for observational and interventional studies.

scholarly journals Clinician Job Searches in the Internet Era: Internet-Based Study (Preprint)

2018 ◽  
Author(s):  
Shalu Gillum ◽  
Natasha Williams ◽  
Brittany Brink ◽  
Edward Ross
Keyword(s):  
Job Search ◽  
Rank Order ◽  
Academic Medical Centers ◽  
The Internet ◽  
Web Based ◽  
Medical Centers ◽  
Academic Medical ◽  
Job Searches ◽  
Job Openings ◽  
Internet Searches

BACKGROUND Traditional methods using print media and commercial firms for clinician recruiting are often limited by cost, slow pace, and suboptimal results. An efficient and fiscally sound approach is needed for searching online to recruit clinicians. OBJECTIVE The aim of the study was to assess the Web-based methods by which clinicians might be searching for jobs in a broad range of specialties and how academic medical centers can advertise clinical job openings to prominently appear on internet searches that would yield the greatest return on investment. METHODS We used a search engine (Google) to identify 8 query terms for each of the specialties and specialists (eg, dermatology and dermatologist) to determine internet job search methodologies for 12 clinical disciplines. Searches were conducted, and the data used for analysis were the first 20 results. RESULTS In total, 176 searches were conducted at varying times over the course of several months, and 3520 results were recorded. The following 4 types of websites appeared in the top 10 search results across all specialties searched, accounting for 52.27% (920/1760) of the results: (1) a single no-cost job aggregator (229/1760, 13.01%); (2) 2 prominent journal-based paid digital job listing services (157/1760, 8.92% and 91/1760, 5.17%, respectively); (3) a fee-based Web-based agency (137/1760, 7.78%) offering candidate profiles; and (4) society-based paid advertisements (totaling 306/1760, 17.38%). These sites accounted for 75.45% (664/880) of results limited to the top 5 results. Repetitive short-term testing yielded similar results with minor changes in the rank order. CONCLUSIONS On the basis of our findings, we offer a specific financially prudent internet strategy for both clinicians searching the internet for employment and employers hiring clinicians in academic medical centers.

Web-based decision aids to support breast cancer screening decisions: systematic review and meta-analysis

2020 ◽  
Vol 9 (14) ◽  
pp. 985-1002
Author(s):  
Lin Yu ◽  
Ping Li ◽  
Shu Yang ◽  
Pingping Guo ◽  
Xuehui Zhang ◽  
...  
Keyword(s):  
Breast Cancer ◽  
Systematic Review ◽  
Decision Making ◽  
Cancer Screening ◽  
Usual Care ◽  
Breast Cancer Screening ◽  
Meta Analysis ◽  
Decision Aids ◽  
Web Based ◽  
Mean Differences

Aim: Breast cancer is a leading cause of cancer among women. Because guidelines on screening for breast cancer for certain ages are controversial, many experts advocate the use of shared decision making (SDM) using validated decision aids (DAs). Recent studies have concluded that DAs are beneficial; however, the results have great heterogeneity. Therefore, further studies are needed to improve understanding of these tools. Objective: This systematic review and meta-analysis aimed to investigate the impact of using web-based DAs in women aged 50 years and below facing the decision to be screened for breast cancer in comparison with usual care. Methods: PubMed, Web of Science, Embase and the Cochrane CENTRAL databases were searched up to February 2020 for studies assessing web-based DAs for women making a breast cancer screening decision and reported quality of decision-making outcomes. Using a random-effects model or a fixed-effects model, meta-analyses were conducted pooling results using mean differences (MD), standardized mean differences (SMD) and relative risks (RR). Results: Of 1097 unique citations, three randomized controlled trials and two before–after studies met the study eligibility criteria. Compared with usual care, web-based DAs increased knowledge (SMD = 0.69; 95% CI: 0.57–0.80; p < 0.00001), reduced decision conflict and increased the proportion of women who made an informed choice (RR = 1.86; 95% CI: 1.38 to 2.50; p < 0.0001), but did not change the intention of women deciding to be screened or affect decision regret. Conclusion: This analysis showed the positive effect of web-based DAs on patient-centered outcomes in breast cancer screening. In the future, more internet devices and free or larger discount WI-FI should be established to ensure more women can benefit from this effective tool.

On the Surprising Longevity of Flogged Horses: Why There Is a Case for the Significance Test

1997 ◽  
Vol 8 (1) ◽  
pp. 12-15 ◽  
Author(s):  
Robert P. Abelson
Keyword(s):  
Null Hypothesis ◽  
Goodness Of Fit ◽  
Meta Analysis ◽  
Significance Test ◽  
Effect Sizes ◽  
Significance Tests ◽  
Frequent Use ◽  
Alternative Procedures ◽  
Mean Differences ◽  
New Research

Criticisms of null-hypothesis significance tests (NHSTs) are reviewed Used as formal, two-valued decision procedures, they often generate misleading conclusions However, critics who argue that NHSTs are totally meaningless because the null hypothesis is virtually always false are overstating their case Critics also neglect the whole class of valuable significance tests that assess goodness of fit of models to data Even as applied to simple mean differences, NHSTs can be rhetorically useful in defending research against criticisms that random factors adequately explain the results, or that the direction of mean difference was not demonstrated convincingly Principled argument and counterargument produce the lore, or communal understanding, in a field, which in turn helps guide new research Alternative procedures–confidence intervals, effect sizes, and meta-analysis–are discussed Although these alternatives are not totally free from criticism either, they deserve more frequent use, without an unwise ban on NHSTs

scholarly journals Suggestibility in functional neurological disorder: A meta-analysis

2020 ◽  
Author(s):  
Lillian Wieder ◽  
Richard J. Brown ◽  
Trevor Thompson ◽  
Devin B. Terhune
Keyword(s):  
Neurological Disorder ◽  
Data Extraction ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Study Quality ◽  
Predisposing Factor ◽  
Search Results ◽  
Mean Differences ◽  
Meta Analyses ◽  
Functional Neurological Disorder

AbstractObjectiveResponsiveness to direct verbal suggestions (suggestibility) has long been hypothesized to represent a predisposing factor for functional neurological disorder (FND) but previous research has yielded conflicting results. The aim of this study was to quantitatively evaluate whether FND patients display elevated suggestibility relative to controls via meta-analysis.MethodsFour electronic databases were searched in November 2019, with the search updated in April 2020, for original studies assessing suggestibility using standardized behavioural scales or suggestive symptom induction protocols in FND patients and controls. The meta-analysis followed Cochrane, PRISMA, and MOOSE guidelines. Data extraction and study quality coding were performed by two independent reviewers. Standardized suggestibility scores and responsiveness to symptom induction protocols were used to calculate standardized mean differences (SMDs) between groups.ResultsOf 26,643 search results, 19 articles presenting 11 standardized suggestibility datasets (FND: n = 316; control: n = 360) and 11 symptom suggestibility datasets (FND: n = 1285; control: n = 1409) were included in random-effects meta-analyses. Meta-analyses revealed that FND patients displayed greater suggestibility than controls on standardized behavioural scales (SMD, 0.48 [95% CI, 0.15, 0.81]) and greater responsiveness to suggestive symptom induction (SMD, 1.39 [95% CI, 0.92, 1.86]). Moderation analyses presented mixed evidence regarding the extent to which effect sizes covaried with methodological differences across studies. No evidence of publication bias was found.ConclusionsThese results corroborate the hypothesis that FND is characterized by heightened responsiveness to verbal suggestion. Atypical suggestibility may confer risk for FND and be a cognitive marker that can inform diagnosis and treatment of this condition.

scholarly journals Meta-Analysis of a Web-Based Disease Forecast System for Control of Anthracnose and Botrytis Fruit Rots of Strawberry in Southeastern United States

Plant Disease ◽  
2017 ◽  
Vol 101 (11) ◽  
pp. 1910-1917 ◽  
Author(s):  
Leandro G. Cordova ◽  
Laurence V. Madden ◽  
Achour Amiri ◽  
Guido Schnabel ◽  
Natalia A. Peres
Keyword(s):  
South Carolina ◽  
Meta Analysis ◽  
Fruit Rot ◽  
Effect Sizes ◽  
Colletotrichum Acutatum ◽  
Web Based ◽  
The Mean ◽  
Disease Forecast ◽  
The Difference ◽  
Marketable Fruit

Strawberry production in Florida and South Carolina is affected by two major diseases, anthracnose fruit rot (AFR) and Botrytis fruit rot (BFR), caused by Colletotrichum acutatum and Botrytis cinerea, respectively. The effective management of both diseases traditionally relied on weekly fungicide applications. However, to improve timing and reduce the number of fungicide sprays, many growers follow the Strawberry Advisory System (StAS), a decision support system for forecasting fungicide applications based on environmental conditions and previously developed models. The objective of this study was to perform a meta-analysis to determine the effectiveness of the StAS for AFR and BFR management compared with a calendar-based spray program. Thirty-nine trials were conducted from 2009 to 2014 in Florida and South Carolina commercial strawberry fields. Meta-analysis was conducted to quantify the treatment effects on four effect sizes, all based on the difference in response variables for StAS and the calendar-based treatments in each trial. The mean difference in BFR incidence, AFR incidence, yield, and number of marketable fruit between the two treatments was not significantly different from 0 (P < 0.05). However, the number of fungicide applications per season was reduced by a median of seven when using the StAS, a 50% reduction in sprays compared with the calendar-based approach. Effect sizes were not influenced by location or the favorability of the environment for disease development. These findings indicate that use of StAS in commercial fields is effective in controlling fruit rot diseases with no reduction in yield while substantially reducing fungicide applications.

scholarly journals Web-Based Teaching Materials in the Covid-19 Pandemic: Implementation of Technological Advancements

2021 ◽  
Vol 05 (01) ◽  
Author(s):  
Fiona Alde Risa ◽  
Keyword(s):  
Meta Analysis ◽  
Learning Activities ◽  
Data Sources ◽  
The Internet ◽  
Literature Study ◽  
Teaching Materials ◽  
Web Based ◽  
A Site ◽  
Practice Questions ◽  
The Web

This study aimed to determine web-based teaching materials in the covid-19 pandemic time as implementation of technological advancements. The method used is literature study or literature review. A literature study is a research design used in collecting data sources related to a topic. It collects data for the study of literature using a database to search for literature sources. Data collection used the Reporting Items for Systematic Review and Meta-Analysis (PRISMA) method. From the results of research and discussion, it can be concluded that the web or website is a site that contains various documents and information that can be accessed by individuals and groups using the internet. Because of its superiority in finding information, the website is widely used as a medium of communication, promoting business, and even learning activities. Through the website, the implementation of learning will be easier and more interesting. Students can access various learning resources through the website, provide complete practice questions, and provide discussion space for students and interesting visualizations.

Sign in / Sign up

Export Citation Format

Share Document