Comparison Between Dichotomous and Polytomous Scoring of Innovative Items in a Large-Scale Computerized Adaptive Test

2011 ◽  
Vol 72 (3) ◽  
pp. 493-509 ◽  
Author(s):  
Hong Jiao ◽  
Junhui Liu ◽  
Kathleen Haynie ◽  
Ada Woo ◽  
Jerry Gorham

This study explored the impact of partial credit scoring of one type of innovative items (multiple-response items) in a computerized adaptive version of a large-scale licensure pretest and operational test settings. The impacts of partial credit scoring on the estimation of the ability parameters and classification decisions in operational test settings were explored in one real data analysis and two simulation studies when two different polytomous scoring algorithms, automated polytomous scoring and rater-generated polytomous scoring, were applied. For the real data analyses, the ability estimates from dichotomous and polytomous scoring were highly correlated; the classification consistency between different scoring algorithms was nearly perfect. Information distribution changed slightly in the operational item bank. In the two simulation studies comparing each polytomous scoring with dichotomous scoring, the ability estimates resulting from polytomous scoring had slightly higher measurement precision than those resulting from dichotomous scoring. The practical impact related to classification decision was minor because of the extremely small number of items that could be scored polytomously in this current study.

2019 ◽  
Vol 21 (5) ◽  
pp. 1756-1765
Author(s):  
Bo Sun ◽  
Liang Chen

Abstract Mapping of expression quantitative trait loci (eQTLs) facilitates interpretation of the regulatory path from genetic variants to their associated disease or traits. High-throughput sequencing of RNA (RNA-seq) has expedited the exploration of these regulatory variants. However, eQTL mapping is usually confronted with the analysis challenges caused by overdispersion and excessive dropouts in RNA-seq. The heavy-tailed distribution of gene expression violates the assumption of Gaussian distributed errors in linear regression for eQTL detection, which results in increased Type I or Type II errors. Applying rank-based inverse normal transformation (INT) can make the expression values more normally distributed. However, INT causes information loss and leads to uninterpretable effect size estimation. After comprehensive examination of the impact from overdispersion and excessive dropouts, we propose to apply a robust model, quantile regression, to map eQTLs for genes with high degree of overdispersion or large number of dropouts. Simulation studies show that quantile regression has the desired robustness to outliers and dropouts, and it significantly improves eQTL mapping. From a real data analysis, the most significant eQTL discoveries differ between quantile regression and the conventional linear model. Such discrepancy becomes more prominent when the dropout effect or the overdispersion effect is large. All the results suggest that quantile regression provides more reliable and accurate eQTL mapping than conventional linear models. It deserves more attention for the large-scale eQTL mapping.


2018 ◽  
Vol 43 (8) ◽  
pp. 611-623 ◽  
Author(s):  
Maxwell R. Hong ◽  
Ying Cheng

In the context of high-stakes tests, test takers who do not have enough time to complete a test rush toward the end and may engage in speeded behavior when tests do not penalize guessing. Using mathematical derivations and simulations, previous research showed that random guessing responses should attenuate interitem correlations, and therefore, decrease estimates of reliability. Meanwhile, other researchers showed that random guessing could in fact inflate reliability estimates using real data. We provide analytical derivations on how speededness could affect correlations between two dichotomous items in multiple ways, depending on the manifestation and prevalence of test speededness. Furthermore, we provide two simulation studies that evaluate the magnitude of impact of test speededness on interitem correlations and Cronbach’s alpha. We found that the impact of test speededness can vary between item pairs and that it depends on the manifestation of test speededness and item level characteristics. Furthermore, speeded responses will, in general, attenuate or not affect reliability estimates, depending on the prevalence of such responses and conceptual interpretation of speeded responses. Implications of the findings are discussed.


2017 ◽  
Vol 28 (2) ◽  
pp. 503-514
Author(s):  
Hua He ◽  
Naiji Lu ◽  
Brady Stephens ◽  
Yinglin Xia ◽  
Robert M Bossarte ◽  
...  

Large-scale public health prevention initiatives and interventions are a very important component to current public health strategies. But evaluating effects of such large-scale prevention/intervention faces a lot of challenges due to confounding effects and heterogeneity of study population. In this paper, we will develop metrics to assess the risk for suicide events based on causal inference framework when the study population is heterogeneous. The proposed metrics deal with the confounding effect by first estimating the risk of suicide events within each of the risk levels, number of prior attempts, and then taking a weighted sum of the conditional probabilities. The metrics provide unbiased estimates of the risk of suicide events. Simulation studies and a real data example will be used to demonstrate the proposed metrics.


2018 ◽  
Author(s):  
Robert Kofler

AbstractIn mammals and in invertebrates the proliferation of a newly invading transposable element (TE) is thought to be stopped by a random insertion of one member of the invading TE family into a piRNA cluster. This view is known as the trap model. Here we explore the dynamics of TE invasions under the trap model using large-scale computer simulations. We found that piRNA clusters confer a substantial benefit, effectively preventing extinction of host populations from an uncontrollable proliferation of deleterious TEs. We show that TE invasions under the trap model consists of three distinct phases: first the TE rapidly amplifies within the population, next TE proliferation is stopped by segregating cluster insertions and finally the TE is permanently inactivated by fixation of a cluster insertion. Suppression by segregating cluster insertions is unstable and bursts of TE activity may yet occur. The transpositon rate and the population size mostly influence the length of the phases but not the amount of TEs accumulating during an invasion. Solely the size of piRNA clusters was identified as a major factor influencing TE abundance. Investigating the impact of different cluster architectures we found that a single non-recombining cluster (e.g. the somatic cluster flamenco in Drosophila) is more efficient in stopping invasions than clusters distributed over several chromosomes (e.g germline cluster in Drosophila). With the somatic architecture fewer TEs accumulate during an invasion and fewer cluster insertions are required to stop the TE. The inefficiency of the germline architecture stems from recombination among cluster sites which makes it necessary that each diploid carries, on the average, four cluster insertions, such that most individuals will end up with at least one cluster insertion. Surprisingly we found that negative selection in a model with piRNA clusters can lead to a novel equilibrium state, where TE copy numbers remain stable despite only some individuals in a population carrying a cluster insertion. Finally when applying our approach to real data from Drosophila melanogaster we found that the trap model reasonably well accounts for the abundance of germline TEs but not of somatic TEs. The abundance of somatic TEs, such as gypsy, is much lower than expected.


2021 ◽  
Vol 647 ◽  
pp. L5
Author(s):  
B. Joachimi ◽  
F. Köhlinger ◽  
W. Handley ◽  
P. Lemos

Summary statistics of likelihood, such as Bayesian evidence, offer a principled way of comparing models and assessing tension between, or within, the results of physical experiments. Noisy realisations of the data induce scatter in these model comparison statistics. For a realistic case of cosmological inference from large-scale structure, we show that the logarithm of the Bayes factor attains scatter of order unity, increasing significantly with stronger tension between the models under comparison. We develop an approximate procedure that quantifies the sampling distribution of the evidence at a small additional computational cost and apply it to real data to demonstrate the impact of the scatter, which acts to reduce the significance of any model discrepancies. Data compression is highlighted as a potential avenue to suppressing noise in the evidence to negligible levels, with a proof of concept demonstrated using Planck cosmic microwave background data.


2018 ◽  
Author(s):  
Maxwell Hong ◽  
Alison Cheng

In the context of high-stakes tests, test takers who do not have enough time to complete a test rush towards the end and may engage in speeded behavior when tests do not penalize guessing. Using mathematical derivations and simulations, Attali (2005) showed that random guessing responses should attenuate inter-item correlations, and therefore decrease estimates of reliability. Meanwhile, Wise and DeMars (2009) showed that random guessing could in fact inflate reliability estimates using real data. We provide analytical derivations on how speededness could affect correlations between two dichotomous items in multiple ways, depending on the manifestation and prevalence of test speededness. Furthermore, we provide two simulation studies that evaluate the magnitude of impact of test speededness on inter-item correlations and Cronbach's Alpha. We found that the impact of test speededness can vary between item pairs and that it depends on the manifestation of test speededness and item level characteristics. Furthermore, speeded responses will, in general, attenuate or not affect reliability estimates, depending on the prevalence of such responses and conceptual interpretation of speeded responses. Implications of the findings are discussed.


2022 ◽  
Author(s):  
Ruqia Al Shidhani ◽  
Ahmed Al Shueili ◽  
Hussain Al Salmi ◽  
Musallam Jaboob

Abstract Due to a resource optimization and efficiency improvements, wells that are hydraulically fractured in the tight gas Barik Formation of the Khazzan Field in the Sultanate of Oman are often temporarily left shut-in directly following a large scale massive hydraulic fracturing stimulation treatment. Extensive industry literature has often suggested (and reported), that this may result in a significant direct loss of productivity due to the delayed flowback and the resulting fracture conductivity and formation damage. This paper will review the available data from the Khazzan Field address these concerns; indicating where the concerns should and should not necessarily apply. The Barik Formation in the Khazzan Field is an over-pressured gas-condensate reservoir at 4,500 m with gas permeability ranging from 0.1 to 20 mD. The average well after hydraulic fracturing produces 25 MMscfd and 500 bcpd against a wellhead pressure of 4,000 psi. A typical hydraulic fracturing stimulation treatment consists of 14,000 bbl of a borate-crosslinked guar fluid, placing upwards of 1MM Lbs of high conductivity bauxite proppant within a single fracture. In order to assess the potential production loss due to delayed flowback operations, BP Oman performed a suite of formation damage tests including core samples from the Barik reservoir, fracture conductivity considerations and dynamic behaviors. Additionally, normalized production was compared between offset wells that were cleaned-up and put onto production at different times after the hydraulic fracturing operations. Core tests showed a range of fracture conductivities over time with delayed flowback after using the breaker concentrations from actual treatments. As expected, enhanced conductivity was achieved with additional breaker. The magnitude of the conductivity being created in these massive treatments was also demonstrated to be dominant with respect to damage effects. Finally, a normalized comparison of an extensive suite of wells clearly showed no discernible loss of production resulted from any delay in the flowback operations. This paper describes in details the workflow and resulting analysis of the impact of extensive shut-in versus immediate flowback post massive hydraulic fracturing. It indicates that the impact of such events will be limited if the appropriate steps have been taken to minimize the opportunity for damage to occur. Whereas the existing fracturing literature takes the safe stance of indicating that damage will always result from such shut-ins, this paper will demonstrate the limitations of such assumptions and the flexibility that can be demonstrated with real data.


2020 ◽  
Vol 59 (04) ◽  
pp. 294-299 ◽  
Author(s):  
Lutz S. Freudenberg ◽  
Ulf Dittmer ◽  
Ken Herrmann

Abstract Introduction Preparations of health systems to accommodate large number of severely ill COVID-19 patients in March/April 2020 has a significant impact on nuclear medicine departments. Materials and Methods A web-based questionnaire was designed to differentiate the impact of the pandemic on inpatient and outpatient nuclear medicine operations and on public versus private health systems, respectively. Questions were addressing the following issues: impact on nuclear medicine diagnostics and therapy, use of recommendations, personal protective equipment, and organizational adaptations. The survey was available for 6 days and closed on April 20, 2020. Results 113 complete responses were recorded. Nearly all participants (97 %) report a decline of nuclear medicine diagnostic procedures. The mean reduction in the last three weeks for PET/CT, scintigraphies of bone, myocardium, lung thyroid, sentinel lymph-node are –14.4 %, –47.2 %, –47.5 %, –40.7 %, –58.4 %, and –25.2 % respectively. Furthermore, 76 % of the participants report a reduction in therapies especially for benign thyroid disease (-41.8 %) and radiosynoviorthesis (–53.8 %) while tumor therapies remained mainly stable. 48 % of the participants report a shortage of personal protective equipment. Conclusions Nuclear medicine services are notably reduced 3 weeks after the SARS-CoV-2 pandemic reached Germany, Austria and Switzerland on a large scale. We must be aware that the current crisis will also have a significant economic impact on the healthcare system. As the survey cannot adapt to daily dynamic changes in priorities, it serves as a first snapshot requiring follow-up studies and comparisons with other countries and regions.


2020 ◽  
Vol 6 (5) ◽  
pp. 1183-1189
Author(s):  
Dr. Tridibesh Tripathy ◽  
Dr. Umakant Prusty ◽  
Dr. Chintamani Nayak ◽  
Dr. Rakesh Dwivedi ◽  
Dr. Mohini Gautam

The current article of Uttar Pradesh (UP) is about the ASHAs who are the daughters-in-law of a family that resides in the same community that they serve as the grassroots health worker since 2005 when the NRHM was introduced in the Empowered Action Group (EAG) states. UP is one such Empowered Action Group (EAG) state. The current study explores the actual responses of Recently Delivered Women (RDW) on their visits during the first month of their recent delivery. From the catchment area of each of the 250 ASHAs, two RDWs were selected who had a child in the age group of 3 to 6 months during the survey. The response profiles of the RDWs on the post- delivery first month visits are dwelled upon to evolve a picture representing the entire state of UP. The relevance of the study assumes significance as detailed data on the modalities of postnatal visits are available but not exclusively for the first month period of their recent delivery. The details of the post-delivery first month period related visits are not available even in large scale surveys like National Family Health Survey 4 done in 2015-16. The current study gives an insight in to these visits with a five-point approach i.e. type of personnel doing the visit, frequency of the visits, visits done in a particular week from among those four weeks separately for the three visits separately. The current study is basically regarding the summary of this Penta approach for the post- delivery one-month period.     The first month period after each delivery deals with 70% of the time of the postnatal period & the entire neonatal period. Therefore, it does impact the Maternal Mortality Rate & Ratio (MMR) & the Neonatal Mortality Rates (NMR) in India and especially in UP through the unsafe Maternal & Neonatal practices in the first month period after delivery. The current MM Rate of UP is 20.1 & MM Ratio is 216 whereas the MM ratio is 122 in India (SRS, 2019). The Sample Registration System (SRS) report also mentions that the Life Time Risk (LTR) of a woman in pregnancy is 0.7% which is the highest in the nation (SRS, 2019). This means it is very risky to give birth in UP in comparison to other regions in the country (SRS, 2019). This risk is at the peak in the first month period after each delivery. Similarly, the current NMR in India is 23 per 1000 livebirths (UNIGME,2018). As NMR data is not available separately for states, the national level data also hold good for the states and that’s how for the state of UP as well. These mortalities are the impact indicators and such indicators can be reduced through long drawn processes that includes effective and timely visits to RDWs especially in the first month period after delivery. This would help in making their post-natal & neonatal stage safe. This is the area of post-delivery first month visit profile detailing that the current article helps in popping out in relation to the recent delivery of the respondents.   A total of four districts of Uttar Pradesh were selected purposively for the study and the data collection was conducted in the villages of the respective districts with the help of a pre-tested structured interview schedule with both close-ended and open-ended questions.  The current article deals with five close ended questions with options, two for the type of personnel & frequency while the other three are for each of the three visits in the first month after the recent delivery of respondents. In addition, in-depth interviews were also conducted amongst the RDWs and a total 500 respondents had participated in the study.   Among the districts related to this article, the results showed that ASHA was the type of personnel who did the majority of visits in all the four districts. On the other hand, 25-40% of RDWs in all the 4 districts replied that they did not receive any visit within the first month of their recent delivery. Regarding frequency, most of the RDWs in all the 4 districts received 1-2 times visits by ASHAs.   Regarding the first visit, it was found that the ASHAs of Barabanki and Gonda visited less percentage of RDWs in the first week after delivery. Similarly, the second visit revealed that about 1.2% RDWs in Banda district could not recall about the visit. Further on the second visit, the RDWs responded that most of them in 3 districts except Gonda district did receive the second postnatal visit in 7-15 days after their recent delivery. Less than half of RDWs in Barabanki district & just more than half of RDWs in Gonda district received the third visit in 15-21 days period after delivery. For the same period, the majority of RDWs in the rest two districts responded that they had been entertained through a home visit.


Sign in / Sign up

Export Citation Format

Share Document