scholarly journals The case for formal methodology in scientific reform

2021 ◽  
Vol 8 (3) ◽  
Author(s):  
Berna Devezer ◽  
Danielle J. Navarro ◽  
Joachim Vandekerckhove ◽  
Erkan Ozge Buzbas

Current attempts at methodological reform in sciences come in response to an overall lack of rigor in methodological and scientific practices in experimental sciences. However, most methodological reform attempts suffer from similar mistakes and over-generalizations to the ones they aim to address. We argue that this can be attributed in part to lack of formalism and first principles. Considering the costs of allowing false claims to become canonized, we argue for formal statistical rigor and scientific nuance in methodological reform. To attain this rigor and nuance, we propose a five-step formal approach for solving methodological problems. To illustrate the use and benefits of such formalism, we present a formal statistical analysis of three popular claims in the metascientific literature: (i) that reproducibility is the cornerstone of science; (ii) that data must not be used twice in any analysis; and (iii) that exploratory projects imply poor statistical practice. We show how our formal approach can inform and shape debates about such methodological claims.

Author(s):  
Berna Devezer ◽  
Danielle J. Navarro ◽  
Joachim Vandekerckhove ◽  
Erkan Ozge Buzbas

AbstractCurrent attempts at methodological reform in sciences come in response to an overall lack of rigor in methodological and scientific practices in experimental sciences. However, most methodological reform attempts suffer from similar mistakes and over-generalizations to the ones they aim to address. We argue that this can be attributed in part to lack of formalism and first principles. Considering the costs of allowing false claims to become canonized, we argue for formal statistical rigor and scientific nuance in methodological reform. To attain this rigor and nuance, we propose a five-step formal approach for solving methodological problems. To illustrate the use and benefits of such formalism, we present a formal statistical analysis of three popular claims in the metascientific literature: (a) that reproducibility is the cornerstone of science; (b) that data must not be used twice in any analysis; and (c) that exploratory projects imply poor statistical practice. We show how our formal approach can inform and shape debates about such methodological claims.


2013 ◽  
Vol 21 (02) ◽  
pp. 1350014
Author(s):  
YI CAI ◽  
DEJIAN LAI ◽  
DOROTHY KIM WALLER ◽  
XIANGLIN DU ◽  
KEITH BURAU ◽  
...  

The frequency of births by day of the week has been reported by several studies without a formal statistical analysis. Births occurring on weekends have been consistently found to be less frequent than births on weekdays. In this study, we compared different statistical methods to assess the effect of the day of the week on the timing of births. We employed two statistical methods, two-way ANOVA and two-way Friedman's test, to analyze the daily variations of 222,735 births from 2005 to 2007 in Harris County, Texas. Both of the statistical tests indicated that births were not uniformly distributed by day of the week. Pairwise comparisons demonstrated that the births occurring on weekends were significantly less frequent than births occurring on weekdays. Our study together with other empirical studies would provide useful information for improving hospital management and the health of infants and their mothers.


1976 ◽  
Vol 1 (1) ◽  
pp. 21-30
Author(s):  
M. Meenakshi Malya

One of the inherent characteristics of capital investment projects is the presence of uncertainties in estimated outlays and future benefits. The concept of sensitivity analysis in project appraisal has been recently extended to include risk analysis. The assessment of the nature and magnitude of uncertainties poses methodological problems. The complexities arising out of interdependencies among the uncertainties necessitate a formal approach to risk analysis. A methodology for assessing the uncertainties, especially when they are interdependent, is outlined here. The application of the methodology is illustrated in the context of a project financed by the World Bank.


Blood ◽  
2012 ◽  
Vol 120 (21) ◽  
pp. 2239-2239
Author(s):  
Valerie Arias ◽  
Ehsan Shabbir ◽  
Daniel Victorio ◽  
Emily Sperling ◽  
Naznin Haq ◽  
...  

Abstract Abstract 2239 Introduction: Socioeconomic, environmental, lifestyle and genetic factors play a role in the etiology of ITP but are poorly understood. A self-reported questionnaire was designed to study these relationships and how these factors prior to the diagnosis of ITP relate to treatment response and disease progression in order to gain insight into the etiology of ITP. Methods: To design the questionnaire that would address topics of interest: 1) 60 ITP patient interviews were performed and 2) the questionnaire was reviewed by project coordinators, nurse practitioners, Platelet Disorder Support Association (PDSA) members, and hematologists. The input was incorporated into a further-revised questionnaire, which was then administered to both “pediatric” (patients <18 years of age at the time of diagnosis) and adult ITP patients from the Platelet Disorders Center at Weill Cornell - New York Presbyterian Hospital. Formal statistical analysis to relate responses to one question to responses of another to define sub-groups of patients is ongoing. Results: 109 patients were enrolled. Ages ranged from 2–78 years of age; median age was 55 years, with 21 females and 33 “pediatric” patients. The most frequent environmental exposures in adults were automotive exhaust (n=14) and Teflon (n=12). In pediatrics, preservatives and insecticides (n=8) and Teflon (n=7) were most common. The most prevalent hazardous substances in both groups were cleaning supplies (n=16 adults, n=9 “pediatric”) and chlorinated water (n=13 adult, n=9 “pediatric”). 13 adults also had exposure to gasoline or diesel fumes. Refer to figure 1. 51(47%) patients reported at least one infection prior to diagnosis with ITP. The most common were Strep throat (n=12); influenza (n=9), and respiratory tract infections (n=8). Twenty-four (22%) patients reported at least one autoimmune disease, including celiac (n=2) and discoid lupus (n=2).Twenty-one patients reported a family history of Type II diabetes, 12 Type I diabetes, 13 osteoarthritis and 10 rheumatoid arthritis. Eight (7%) patients reported at least one inflammatory disease including: Crohn's disease (n=3), Inflammatory bowel disease (n=7), Systemic lupus erythematous and Vitiligo(each n=1). Thirty-seven (34%) patients reported surgeries prior to diagnosis of ITP, especially: appendectomy (n=8) and tonsil removal (n=8). Twenty-three patients traveled close to date of diagnosis, 58 patients reported more stress than usual (i.e. death of a relative, loss of employment); 13 patients reported a drastic change in diet (i.e. decreasing calories (n=7) or becoming vegetarian (n=5)). Vitamin supplementation for vitamin C and D (each n=17), E (n=12) and B (n=11) were common. In addition, 11 vitamin deficiencies were reported, vitamin D (n=5), vitamin B12 (n=3) and other (n=3). The most frequent allergic reactions included: 31 (28%) patients with hay fever, 9 patients with allergies to milk, 7 patients with poison ivy or skin irritation, 6 patients with eczema, and 4 with allergic rhinitis. Other medical conditions reported were: hypothyroidism (n=10), hyperthyroidism (n=9), high blood pressure (N=16), high cholesterol (N=14), and anemia (N=13) [9 additional patients included 4 with iron deficiency anemia and 5 with a family history of iron deficiency anemia]. Seven patients reported a lack of prenatal care in their mothers' pregnancy and 7 were premature. Medications reported include: acetaminophen (n=53), antibiotics (n=36), antihistamines (n=22), and hormone therapy (n=17). Vaccinations received close to date of diagnosis include: flu vaccine (n=10) and T-dap (n=9). Prednisone was reported most frequently as both the best therapy to minimize symptoms (n=18) and the worst (n=16). Conclusion: Our pilot study intended to capture critical information and to further development of the questionnaire. We can see if there are groups of patients in whom onset and other characteristics relate to outcomes including response to treatment. Following formal statistical analysis of the material acquired (in progress and anticipated by early September), the next step will be for a final updated version of the questionnaire to be posted on the PDSA web site in order to accrue responses from a much larger number of patients. The questionnaire will also be given to a non-ITP patient population to serve as controls. Disclosures: Bussel: Amgen: Family owns Amgen stock Other, Membership on an entity's Board of Directors or advisory committees, Research Funding; Cangene: Research Funding; GlaxoSmithKline: Family owns GSK stock, Family owns GSK stock Other, Membership on an entity's Board of Directors or advisory committees, Research Funding; Genzyme: Research Funding; IgG of America: Research Funding; Immunomedics: Research Funding; Ligand: Membership on an entity's Board of Directors or advisory committees, Research Funding; Eisai: Membership on an entity's Board of Directors or advisory committees, Research Funding; Shionogi: Membership on an entity's Board of Directors or advisory committees, Research Funding; Sysmex: Research Funding; Portola: Consultancy. Off Label Use: The use of romiplostim in pediatric patients was examined in this study.


1991 ◽  
Vol 71 (2) ◽  
pp. 571-573 ◽  
Author(s):  
L. P. Lefkovitch

Rating scale data need not be manipulated to satisfy the assumptions of the analysis of variance, but formed into an incidence table classified by the ratings and other factors, and compacted over factors to focus on those which are important. References are given to methods for formal statistical analysis of these tables. Key words: Subjective rating, ordinal logistic


Author(s):  
Katarzyna Cymbranowicz

The labour market is usually associated with phenomena such as unemployment, employment and professional activity/inactivity. The ways in which these categories are shaped depend on various factors of an economic, social and technological nature. It is impossible to disagree with the statement that the contemporary labour market – local, national, and global – is undergoing dynamic changes. In the public debate, the themes of flexicurity, flexible forms of employment, reconciling professional work with private life, and lifelong learning appear more frequently. They cause heated discussions and often also controversies, since their impact on the situation of workers and employers in the labour market is increasing. Observing the trends in the world economy and the global labour market, it can be argued that employment becomes a privilege.Due to the reasons mentioned above, in the paper, issues which relate to ‘incomplete’ employment are discussed. Theoretical considerations are focused on the terminological and methodological problems related to the interpretation of the concept of underemployment both in the Polish and foreign literature. Furthermore, the relationships between the phenomenon of underemployment and the concept of employment flexibility and security are presented, since they are extremely important from the perspective of the contemporary labour market. The theoretical analysis is complemented by a statistical analysis of empirical data that illustrates the current scale of the phenomenon of underemployment in the labour market in Poland compared to other European Union member states (EU-28). The article adopts the research thesis that in Poland there is a problem of ‘incomplete’ employment. Therefore, the aim of this paper is to attempt to identify the scale of this phenomenon on the Polish labour market. Implementation of this objective will be possible thanks to the study of national and foreign literature and a conducted statistical analysis of selected indicators of the labour market in the context of this phenomenon, obtained from the database of the European Statistical Office (Eurostat).


2017 ◽  
Vol 821 ◽  
pp. 296-329 ◽  
Author(s):  
Matthew Durey ◽  
Paul A. Milewski

A droplet may ‘walk’ across the surface of a vertically vibrating bath of the same fluid, due to the propulsive interaction with its wave field. This hydrodynamic pilot-wave system exhibits many dynamics previously believed to exist only in the quantum realm. Starting from first principles, we derive a discrete-time fluid model, whereby the bath–droplet interactions are modelled as instantaneous. By analysing the stability of the fixed points of the system, we explain the dynamics of a walking droplet and capture the quantisations for multiple-droplet interactions. Circular orbits in a harmonic potential are studied, and a double quantisation of chaotic trajectories is obtained through systematic statistical analysis.


Sign in / Sign up

Export Citation Format

Share Document