scholarly journals Deciding what to replicate: A formal definition of “replication value” and a decision model for replication study selection.

2020 ◽  
Author(s):  
Peder Mortvedt Isager ◽  
Robbie Cornelis Maria van Aert ◽  
Štěpán Bahník ◽  
Mark John Brandt ◽  
Kurt Andrew DeSoto ◽  
...  
Keyword(s):  
Expected Utility ◽  
Decision Model ◽  
General Rule ◽  
Difficult Problem ◽  
Current Evidence ◽  
Replication Studies ◽  
Study Selection ◽  
Utility Gain ◽  
Replication Research ◽  
Definition Of

Robust scientific knowledge is contingent upon replication of original findings. However, researchers who conduct replication studies face a difficult problem; there are many more studies in need of replication than there are funds available for replicating. To select studies for replication efficiently, we need to understand which studies are the most in need of replication. In other words, we need to understand which replication efforts have the highest expected utility. In this article we propose a general rule for study selection in replication research based on the replication value of the claims considered for replication. The replication value of a claim is defined as the maximum expected utility we could gain by replicating the claim, and is a function of (1) the value of being certain about the claim, and (2) uncertainty about the claim based on current evidence. We formalize this definition in terms of a causal decision model, utilizing concepts from decision theory and causal graph modeling. We discuss the validity of using replication value as a measure of expected utility gain, and we suggest approaches for deriving quantitative estimates of replication value.

Progeny Review

2016 ◽  
Vol 37 (4) ◽  
pp. 235-243 ◽  
Author(s):  
William J. Therrien ◽  
Hannah M. Mathews ◽  
Shanna Eisner Hirsch ◽  
Michael Solis
Keyword(s):  
Special Education ◽  
Random Sampling ◽  
Evidence Base ◽  
Sampling Procedure ◽  
Stratified Random Sampling ◽  
Replication Rate ◽  
Replication Studies ◽  
Child Study ◽  
Replication Research ◽  
Definition Of

Despite the importance of replication for building an evidence base, there has been no formal examination to date of replication research in special education. In this review, we examined the extent and nature of replication of intervention research in special education using an “article progeny” approach and a three-pronged definition of replication (direct, conceptual, intervention overlap). In this approach, original articles (i.e., parent studies) were selected via a stratified, random sampling procedure. Next, we examined all articles that referenced the parent articles (i.e., child studies) to determine the extent and nature of the replication of the original studies. Seventy-five percent of the parent studies were replicated by at least one child study. Across all parent studies, there were 39 replication child studies. Although there was a high overall replication rate, there were a limited number of conceptual replications, and no direct replication studies were identified.

scholarly journals Replication value as a function of citation impact and sample size

2021 ◽  
Author(s):  
Peder Mortvedt Isager ◽  
Anna Elisabeth van 't Veer ◽  
Daniel Lakens
Keyword(s):  
Sample Size ◽  
Expected Utility ◽  
Citation Count ◽  
Citation Impact ◽  
Selection Procedure ◽  
Replication Study ◽  
Selection Strategy ◽  
Original Research ◽  
Study Selection ◽  
Utility Gain

Researchers seeking to replicate original research often need to decide which of several relevant candidates to select for replication. Several strategies for study selection have been proposed, utilizing a variety of observed indicators as criteria for selection. However, few strategies clearly specify the goal of study selection and how that goal is related to the indicators that are utilized. We have previously formalized a decision model of replication study selection in which the goal of study selection is to maximize the expected utility gain of the replication e?ort. We further define the concept of replication value as a proxy for expected utility gain (Isager et al., 2020). In this article, we propose a quantitative operationalization of replication value. Wefirst discuss how value and uncertainty - the two concepts used to determine replication value – could be estimated via information about citation count and sample size. Second, we propose an equation for combining these indicators into an overall estimate of replication value, which we denote RVCn. Third, we suggest how RVCn could be implemented as part of a broader study selection procedure. Finally, we provide preliminary data suggesting that studies that were in fact selected for replication tend to have relatively high RVCn estimates. The goal of this article is to explain how RVCn is intended to work and, in doing so, demonstrate the many assumptions that should be explicit in any replication study selection strategy.

Holding replication studies to mainstream standards of evidence

2018 ◽  
Vol 41 ◽  
Author(s):  
Duane T. Wegener ◽  
Leandre R. Fabrigar
Keyword(s):  
Replication Studies ◽  
Replication Research ◽  
Standards Of Evidence ◽  
Do So

AbstractReplications can make theoretical contributions, but are unlikely to do so if their findings are open to multiple interpretations (especially violations of psychometric invariance). Thus, just as studies demonstrating novel effects are often expected to empirically evaluate competing explanations, replications should be held to similar standards. Unfortunately, this is rarely done, thereby undermining the value of replication research.

WoCoVA consensus on the clinical use of in-line filtration during intravenous infusions: Current evidence and recommendations for future research

2021 ◽  
pp. 112972982198916
Author(s):  
Ton Van Boxtel ◽  
Mauro Pittiruti ◽  
Annemarie Arkema ◽  
Patrick Ball ◽  
Giovanni Barone ◽  
...  
Keyword(s):  
Potential Benefit ◽  
Scientific Evidence ◽  
Venous Access ◽  
Current Evidence ◽  
Future Research ◽  
Global Awareness ◽  
Current State ◽  
Intravenous Infusions ◽  
Proper Definition ◽  
Definition Of

The need for filtering intravenous infusions has long been recognized in the field of venous access, though hard scientific evidence about the actual indications for in-line filters has been scarce. In the last few years, several papers and a few clinical studies have raised again this issue, suggesting that the time has come for a proper definition of the type of filtration, of its potential benefit, and of its proper indications in clinical practice. The WoCoVA Foundation, whose goal is to increase the global awareness on the risk of intravenous access and on patients’ safety, developed the project of a consensus on intravenous filtration. A panel of experts in different aspects of intravenous infusion was chosen to express the current state of knowledge about filtration and to indicate the direction of future research in this field. The present document reports the final conclusions of the panel.

A Systematic Review of Replicative Self-Determination Intervention Studies

2019 ◽  
Vol 54 (1) ◽  
pp. 29-39
Author(s):  
John L. Luckner ◽  
Rashida Banerjee ◽  
Sara Movahedazarhouligh ◽  
Kaitlyn Millen
Keyword(s):  
Systematic Review ◽  
Intervention Studies ◽  
Self Determination ◽  
Future Research ◽  
Replication Studies ◽  
Research Designs ◽  
Replication Research ◽  
Quality Of Research

Current federal legislation emphasizes the use of programs, interventions, strategies, and activities that have been demonstrated through research to be effective. One way to increase the quantity and quality of research that guides practice is to conduct replication research. The purpose of this study was to undertake a systematic review of the replication research focused on self-determination conducted between 2007 and 2017. Using methods used by Cook and colleagues, we identified 80 intervention studies on topics related to self-determination, of which 31 were coded as replications. Intervention study trends, rate of replication studies, percentage of agreements between findings of original and replication studies, amount of author overlap, and types of research designs used are reported along with recommendations for future research.

scholarly journals Current Evidence and Future Perspectives on the Effective Practice of Patient-Centered Laboratory Medicine

2015 ◽  
Vol 61 (4) ◽  
pp. 589-599 ◽  
Author(s):  
Mike J Hallworth ◽  
Paul L Epner ◽  
Christoph Ebert ◽  
Corinne R Fantz ◽  
Sherry A Faye ◽  
...  
Keyword(s):  
Patient Outcomes ◽  
Clinical Effectiveness ◽  
Laboratory Medicine ◽  
Current Evidence ◽  
Patient Centered ◽  
Definition Of ◽  
Current Utilization ◽  
Measures Of Effectiveness ◽  
The Impact ◽  
Primary Measure

AbstractBACKGROUNDSystematic evidence of the contribution made by laboratory medicine to patient outcomes and the overall process of healthcare is difficult to find. An understanding of the value of laboratory medicine, how it can be determined, and the various factors that influence it is vital to ensuring that the service is provided and used optimally.CONTENTThis review summarizes existing evidence supporting the impact of laboratory medicine in healthcare and indicates the gaps in our understanding. It also identifies deficiencies in current utilization, suggests potential solutions, and offers a vision of a future in which laboratory medicine is used optimally to support patient care.SUMMARYTo maximize the value of laboratory medicine, work is required in 5 areas: (a) improved utilization of existing and new tests; (b) definition of new roles for laboratory professionals that are focused on optimizing patient outcomes by adding value at all points of the diagnostic brain-to-brain cycle; (c) development of standardized protocols for prospective patient-centered studies of biomarker clinical effectiveness or extraanalytical process effectiveness; (d) benchmarking of existing and new tests in specified situations with commonly accepted measures of effectiveness; (e) agreed definition and validation of effectiveness measures and use of checklists for articles submitted for publication. Progress in these areas is essential if we are to demonstrate and enhance the value of laboratory medicine and prevent valuable information being lost in meaningless data. This requires effective collaboration with clinicians, and a determination to accept patient outcome and patient experience as the primary measure of laboratory effectiveness.

scholarly journals Performance of Portfolios Based on the Expected Utility-Entropy Fund Rating Approach

Entropy ◽  
2021 ◽  
Vol 23 (4) ◽  
pp. 481
Author(s):  
Daniel Chiew ◽  
Judy Qiu ◽  
Sirimon Treepongkaruna ◽  
Jiping Yang ◽  
Chenxiao Shi
Keyword(s):  
Mutual Funds ◽  
Portfolio Selection ◽  
Expected Utility ◽  
Decision Model ◽  
Risky Choice ◽  
Numerical Representation ◽  
Better Than ◽  
The Eu

Yang and Qiu proposed and reframed an expected utility–entropy (EU-E) based decision model. Later on, a similar numerical representation for a risky choice was axiomatically developed by Luce et al. under the condition of segregation. Recently, we established a fund rating approach based on the EU-E decision model and Morningstar ratings. In this paper, we apply the approach to US mutual funds and construct portfolios using the best rating funds. Furthermore, we evaluate the performance of the fund ratings based on the EU-E decision model against Morningstar ratings by examining the performance of the three models in portfolio selection. The conclusions show that portfolios constructed using the ratings based on the EU-E models with moderate tradeoff coefficients perform better than those constructed using Morningstar. The conclusion is robust to different rebalancing intervals.

scholarly journals What is a balanced knee replacement?

2018 ◽  
Vol 3 (12) ◽  
pp. 614-619 ◽  
Author(s):  
Lucy C. Walker ◽  
Nick D. Clement ◽  
Kanishka M. Ghosh ◽  
David J. Deehan
Keyword(s):  
Total Knee Arthroplasty ◽  
Soft Tissue ◽  
Knee Replacement ◽  
Knee Arthroplasty ◽  
Current Evidence ◽  
Soft Tissue Envelope ◽  
Total Knee ◽  
Uneven Wear ◽  
Definition Of ◽  
Revision Tka

For multifactorial reasons an estimated 20% of patients remain unsatisfied after total knee arthroplasty (TKA). Appropriate tension of the soft tissue envelope encompassing the knee is important in total knee arthroplasty and soft tissue imbalance contributes to several of the foremost reasons for revision TKA, including instability, stiffness and aseptic loosening. There is debate in the literature surrounding the optimum way to achieve balancing of a total knee arthroplasty and there is also a lack of an accepted definition of what a balanced knee replacement is. It may be intuitive to use the native knee as a model for balancing; however, there are many difficulties with translating this into a successful prosthesis. One of the foundations of TKA, as described by Insall, was that although the native knee has more weight transmitted through the medial compartment this was to be avoided in a TKA as it would lead to uneven wear and early failure. There is a focus on achieving symmetrical tension and pressure and subsequent ‘balance’ in TKA, but the evidence from cadaveric studies is that the native knee is not symmetrically balanced. As we are currently trying to design an implant that is not based on its anatomical counterpart, is it possible to create a truly balanced prosthesis or to even to define what that balance is? The authors have reviewed the current evidence surrounding TKA balancing and its relationship with the native knee. Cite this article: EFORT Open Rev 2018;3:614-619. DOI: 10.1302/2058-5241.3.180008.

scholarly journals A VINCULAÇÃO DO PRINCÍPIO PROCESSUAL DA NÃO-SURPRESA E A APLICAÇÃO DA LEI DE INTRODUÇÃO ÀS NORMAS DO DIREITO BRASILEIRO – LINDB

Percurso ◽  
2019 ◽  
Vol 3 (30) ◽  
pp. 42
Author(s):  
Frabriccio Petreli TAROSSO
Keyword(s):  
Decision Making ◽  
General Rule ◽  
Case Law ◽  
Public Law ◽  
Tax Law ◽  
The Novel ◽  
Legal Certainty ◽  
Federal Law ◽  
National Tax ◽  
Definition Of

RESUMOO presente artigo pretende aproximar alguns conceitos da novel Lei de Introdução às Normas do Direito Brasileiro – LINDB ao princípio da não-surpresa aplicável ao processo tributário, seja ele Administrativo ou Judicial. A Lei Federal n. 13.655 de 25/04/2018 houve por incluir no Decreto-Lei nº 4.657, de 4 de setembro de 1942 - Lei de Introdução às Normas do Direito Brasileiro - disposições sobre segurança jurídica e eficiência na criação e na aplicação do direito público. Deste modo, muitas dúvidas têm surgido acerca da convivência entre a regra geral de direito tributário, inserta no Art. 144 do Código Tributário Nacional, de que a lei vigente à época dos fatos geradores deve ser levada em conta ao deslinde de uma questão e que a jurisprudência majoritária à época dos mesmos fatos – se modificada – não deve servir de parâmetro para a tomada das decisões. PALAVRAS-CHAVE: Lei de Introdução às Normas do Direito Brasileiro – LINDB; Princípio Processual da não-surpresa.ABSTRACTThe present article intends to approximate some concepts of the novel Law of Introduction to the Norms of Brazilian Law - LINDB to the principle of non-surprise applicable to the tax process, be it Administrative or Judicial. Federal Law n. 13,655 dated 04/25/2018, there was a need to include in Decree-Law No. 4.657, dated September 4, 1942 - Law on Introduction to the Rules of Brazilian Law - provisions on legal certainty and efficiency in the creation and application of public law. In this way, many doubts have arisen about the coexistence between the general rule of tax law, inserted in Article 144 of the National Tax Code, that the law in force at the time of the generating facts must be taken into account in the definition of an issue and that the majority case-law at the time of the same facts - if modified - should not serve as a parameter for decision-making. The study will have as a method the legal and bibliographical research on the subject.KEYWORDS: Law of Introduction to the Norms of Brazilian Law – LINDB; Procedural Principle of Non-Surpris

Sign in / Sign up

Export Citation Format

Share Document