scholarly journals Test Quality

2021 ◽  
pp. 77-84
Author(s):  
Raphael Wess ◽  
Heiner Klock ◽  
Hans-Stefan Siller ◽  
Gilbert Greefrath
Keyword(s):  
Secondary Education ◽  
Reliability And Validity ◽  
Quality Criteria ◽  
Test Quality ◽  
Quality Test ◽  
High Quality ◽  
Data Set ◽  
Secondary Quality ◽  
German Universities

AbstractGeneral standards in the form of quality criteria can be used in order to assess the quality of an instrument and/or to construct a high-quality test. Three main indicators, the so-called “core quality criteria,” have emerged: objectivity, reliability and validity (e.g. Bühner, 2011; Ebel & Frisbie, 1991; Linn, 2011; Miller, Linn & Grolund, 2009; Rost, 2004). These primary and selected secondary quality criteria (fairness and usability) are examined in more detail in the following using a data set of 349 pre-service teachers for secondary education at several German universities.

Researchers' judgment criteria of high-quality answers on academic social Q&A platforms

2020 ◽  
Vol 44 (3) ◽  
pp. 603-623 ◽  
Author(s):  
Lei Li ◽  
Chengzhi Zhang ◽  
Daqing He ◽  
Jia Tina Du
Keyword(s):  
Design Methodology ◽  
Information Science ◽  
Value Added ◽  
Quality Criteria ◽  
Social Networking Site ◽  
Library And Information Science ◽  
High Quality ◽  
Content Type ◽  
Second Stage

PurposeThrough a two-stage survey, this paper examines how researchers judge the quality of answers on ResearchGate Q&A, an academic social networking site.Design/methodology/approachIn the first-stage survey, 15 researchers from Library and Information Science (LIS) judged the quality of 157 answers to 15 questions and reported the criteria that they had used. The content of their reports was analyzed, and the results were merged with relevant criteria from the literature to form the second-stage survey questionnaire. This questionnaire was then completed by researchers recognized as accomplished at identifying high-quality LIS answers on ResearchGate Q&A.FindingsMost of the identified quality criteria for academic answers—such as relevance, completeness, and verifiability—have previously been found applicable to generic answers. The authors also found other criteria, such as comprehensiveness, the answerer's scholarship, and value-added. Providing opinions was found to be the most important criterion, followed by completeness and value-added.Originality/valueThe findings here show the importance of studying the quality of answers on academic social Q&A platforms and reveal unique considerations for the design of such systems.

scholarly journals Testing the validity of regional detail in global analyses of Sea surface temperature – the case of Chinese coastal waters

2018 ◽  
Author(s):  
Yan Li ◽  
Hans von Storch ◽  
Qingyyuan Wang ◽  
Qingliang Zhou
Keyword(s):  
Quality Data ◽  
Careful Examination ◽  
Local Data ◽  
High Quality ◽  
Data Set ◽  
Time Period ◽  
Chinese Coast ◽  
Local Quality ◽  
Break Points

Abstract. We have designed a method for testing the quality of multidecadal analyses of SST in regional seas by using a set of high-quality local SST observations. In recognizing that local data may reflect local effects, we focus on dominant EOFs of the local data and of the localized data of the analyses. We examine patterns, and the variability as well as the trends of the principal components. This method is applied to examine four different SST analyses, namely HadISST1, ERSST, COBE SST, and NOAA OISST. They are assessed using a newly constructed high-quality data set of SST at 26 coastal stations along the Chinese coast in 1960–2015 which underwent careful examination with respect to quality, and a number of corrections of inhomogeneities. The four gridded analyses perform by and large well, in particular since 1980. However, for the pre-satellite time period, before 1980, the analyses differ among each other and show some inconsistencies with the local data, such as artificial break points, periods of bias and differences in trends. We conclude that gridded SST-analyses need improvement in the pre-satellite time (prior to 1980s), by re-examining in detail archives of local quality-controlled SST data in many data-sparse regions of the world.

scholarly journals Initial MST radar observations of upper tropospheric-lower stratospheric duct-like structures over Jicamarca, Peru

2012 ◽  
Vol 12 (22) ◽  
pp. 11085-11093 ◽  
Author(s):  
Z. Li ◽  
S. Naqvi ◽  
A. J. Gerrard ◽  
J. L. Chau ◽  
Y. Bhattacharya
Keyword(s):  
Gravity Waves ◽  
Lower Stratosphere ◽  
Physical Nature ◽  
High Quality ◽  
Data Set ◽  
Upper Troposphere ◽  
Atmospheric Fronts ◽  
Mst Radar ◽  
Wind Measurements

Abstract. Persistent wind jet structures along zonal and meridional fields, believed to be caused by stationary gravity waves, were detected in February 1999 in mesosphere-stratosphere-troposphere (MST) radar wind measurements of the troposphere and lower stratosphere over Jicamarca, Peru. Over a continuous seven day span of MST-data analyzed in this study, two days of observations showed signatures of wave-like structures in the upper troposphere/lower stratosphere wind jets associated with the phases of the stationary gravity waves. We believe these wave-like structures are ducted gravity waves. We present these initial observations, their characteristics, and the results of simple numerical simulations used in an attempt to mimic these observed features. Although a fair replication of the observed ducted structure in the numerical model is found, the observed period of ~90 min is nonetheless much longer than what is traditionally observed. As a result, the specific physical nature of the observed structures is not fully established. Nevertheless, given the high quality of the observations, we demonstrate here that continued analysis of this data set and concurrent modeling efforts will allow for a better understanding of Doppler ducts at high spatial and temporal resolution, and the results presented here can ultimately be applied to studies of middle atmospheric fronts, ducts, and bores.

scholarly journals Providing statistical stability of qualimetric studies on the basis of geochronological tracking

2021 ◽  
Vol 2094 (4) ◽  
pp. 042004
Author(s):  
Ya A Ivakin ◽  
E G Semenova ◽  
A G Ruchev ◽  
M S Smirnova
Keyword(s):  
Information Technology ◽  
Reliability And Validity ◽  
Efficiency Analysis ◽  
High Quality ◽  
Statistical Verification ◽  
Transport Services ◽  
Methodological Tool ◽  
Remote Services ◽  
Spatio Temporal

Abstract Geochronological tracking has received wide recognition as an appropriate scientific and methodological tool and an effective information technology of qualimetric research in the interests of ensuring high quality of transport services, transportation efficiency, analysis of the facts of insufficient meeting the needs of the population with spatially remote services, etc. On the basis of geochronotracking, a procedure has been developed for statistical verification of research hypotheses about stable trends in changes in the quality of various spatio-temporal processes. The reliability and validity of accepting a particular hypothesis in the framework of a qualimetric research is determined by the representativeness of the volume of initial data on geographical movements, considered as a selection from the general population. This article is devoted to the analysis of this dependence and the development of an algorithm for assessing the specified stability (significance).

The effects of psychotherapy for adult depression are overestimated: a meta-analysis of study quality and effect size

2009 ◽  
Vol 40 (2) ◽  
pp. 211-223 ◽  
Author(s):  
P. Cuijpers ◽  
A. van Straten ◽  
E. Bohlmeijer ◽  
S. D. Hollon ◽  
G. Andersson
Keyword(s):  
Effect Size ◽  
Analytical Study ◽  
Meta Analysis ◽  
Quality Criteria ◽  
Treatment Manual ◽  
High Quality ◽  
Intention To Treat ◽  
Randomized Controlled ◽  
Adult Depression

BackgroundNo meta-analytical study has examined whether the quality of the studies examining psychotherapy for adult depression is associated with the effect sizes found. This study assesses this association.MethodWe used a database of 115 randomized controlled trials in which 178 psychotherapies for adult depression were compared to a control condition. Eight quality criteria were assessed by two independent coders: participants met diagnostic criteria for a depressive disorder, a treatment manual was used, the therapists were trained, treatment integrity was checked, intention-to-treat analyses were used, N⩾50, randomization was conducted by an independent party, and assessors of outcome were blinded.ResultsOnly 11 studies (16 comparisons) met the eight quality criteria. The standardized mean effect size found for the high-quality studies (d=0.22) was significantly smaller than in the other studies (d=0.74, p<0.001), even after restricting the sample to the subset of other studies that used the kind of care-as-usual or non-specific controls that tended to be used in the high-quality studies. Heterogeneity was zero in the group of high-quality studies. The numbers needed to be treated in the high-quality studies was 8, while it was 2 in the lower-quality studies.ConclusionsWe found strong evidence that the effects of psychotherapy for adult depression have been overestimated in meta-analytical studies. Although the effects of psychotherapy are significant, they are much smaller than was assumed until now, even after controlling for the type of control condition used.

scholarly journals Outstanding Videogames on Water: a Quality Assessment Review Based on Evidences of Narrative, Gameplay & Didactic Criteria

2018 ◽  
Author(s):  
Laura Galván-Pérez ◽  
Tania Ouariachi ◽  
Mª Teresa Pozo-Llorente ◽  
José Gutiérrez-Pérez
Keyword(s):  
Quality Assessment ◽  
Present Article ◽  
Quality Indicator ◽  
Quality Criteria ◽  
High Quality ◽  
Design Validation ◽  
Adventure Games ◽  
Water Based ◽  
Game Simulation

Videogames have become educational, communicative and social tools among the youngest, favouring the acquisition of skills, abilities and values, encompassing an endless number of themes, and help to experience and to face, in the first person, a great diversity of environmental situations and ecology problems. Thus, the present article aims: a) the evaluation of a sample of 20 educational videogames about water, making use of some empirical criteria of quality; and b) the design, validation and application of an integrate quality indicator of educational videogames on water, based on the aspects of narrative, gameplay and didactics to that sample, which allows us to obtain a ranking. The findings reflect a ranking of games allows to suggest that the nature of the game (simulation, adventures, platforms or questions) does not determine the quality of the game, although generally simulations and adventure games are placed in a range of medium or high quality, as well as those games that pursue objectives related to the design and management of a territory in a sustainable way. The paper provides teachers with quality criteria based on narrative and gameplay that complement and enriches the pedagogical dimension.

scholarly journals Outstanding Videogames on Water: A Quality Assessment Review Based on Evidence of Narrative, Gameplay and Educational Criteria

Water ◽  
2018 ◽  
Vol 10 (10) ◽  
pp. 1404 ◽  
Author(s):  
Laura Galván-Pérez ◽  
Tania Ouariachi ◽  
M.ª Pozo-Llorente ◽  
José Gutiérrez-Pérez
Keyword(s):  
Quality Assessment ◽  
Present Article ◽  
Quality Indicator ◽  
Quality Criteria ◽  
First Person ◽  
High Quality ◽  
Adventure Games ◽  
Water Based ◽  
Game Simulation

Videogames have become educational, communicative and social tools among the young, favouring the acquisition of skills, abilities and values, encompassing an endless number of themes, and helping them to experience and to face, in the first person, a great diversity of environmental situations and ecology problems. Thus, the present article aims: (a) to evaluate a sample of 20 educational videogames about water, making use of some empirical criteria of quality; and (b) to design, validate and apply an integrated quality indicator of educational videogames on water, based on the aspects of narrative, gameplay and education, which allows us to obtain a ranking. The findings reflect a ranking of games allowing us to suggest that the nature of the game (simulation, adventures, platforms or questions) does not determine the quality of the game, although generally simulations and adventure games are placed in a range of medium- or high-quality, as well as those games that pursue objectives related to the design and management of a territory in a sustainable way. The paper provides teachers with quality criteria based on narrative and gameplay that complement and enrich the pedagogical dimension.

scholarly journals Numerical modeling of lower stratospheric Doppler ducted gravity waves over Jicamarca, Peru

2011 ◽  
Vol 11 (7) ◽  
pp. 19011-19027
Author(s):  
Z. Li ◽  
S. Naqvi ◽  
A. J. Gerrard ◽  
J. L. Chau ◽  
Y. Bhattacharya
Keyword(s):  
Numerical Modeling ◽  
Numerical Model ◽  
Gravity Waves ◽  
Lower Stratosphere ◽  
Physical Nature ◽  
High Quality ◽  
Data Set ◽  
Upper Troposphere ◽  
Wind Measurements

Abstract. Persistent jet structures along zonal and meridional fields, believed to be caused by stationary gravity waves, were detected in February 1999 in MST wind measurements of the troposphere and lower stratosphere over Jicamarca, Peru. Over a seven day span, two days of observations showed signatures of a Doppler ducted gravity wave in the upper troposphere/lower stratosphere. Herein we present the observations, their characteristics, and results of numerical simulations used to mimic these observed features. Though a fair replication of the observed ducted structure in the numerical model is found, the observed period of ~90 min is nonetheless longer than anticipated and raises concern as to the specific physical nature of the observed structures. However, given the high quality of the observations, we demonstrate that continued analysis of this data set and concurrent modeling will allow for a better understanding of Doppler ducts at high spatial and temporal resolution which can ultimately be applied to studies of mesospheric ducts and bores.

Sign in / Sign up

Export Citation Format

Share Document