scholarly journals USP: an independence test that improves on Pearson’s chi-squared and the G -test

2021 ◽  
Vol 477 (2256) ◽  
Author(s):  
Thomas B. Berrett ◽  
Richard J. Samworth
Keyword(s):  
Simulated Data ◽  
Real Data ◽  
Minimum Variance ◽  
Test Statistic ◽  
Test Of Independence ◽  
Exact Test ◽  
Cell Counts ◽  
Chi Squared ◽  
Measure Of Dependence ◽  
Zero Cell

We present the U -statistic permutation (USP) test of independence in the context of discrete data displayed in a contingency table. Either Pearson’s χ 2 -test of independence, or the G -test, are typically used for this task, but we argue that these tests have serious deficiencies, both in terms of their inability to control the size of the test, and their power properties. By contrast, the USP test is guaranteed to control the size of the test at the nominal level for all sample sizes, has no issues with small (or zero) cell counts, and is able to detect distributions that violate independence in only a minimal way. The test statistic is derived from a U -statistic estimator of a natural population measure of dependence, and we prove that this is the unique minimum variance unbiased estimator of this population quantity. The practical utility of the USP test is demonstrated on both simulated data, where its power can be dramatically greater than those of Pearson’s test, the G -test and Fisher’s exact test, and on real data. The USP test is implemented in the R package USP .

scholarly journals Overcoming confounding plate effects in differential expression analyses of single-cell RNA-seq data

2016 ◽  
Author(s):  
Aaron T. L. Lun ◽  
John C. Marioni
Keyword(s):  
Single Cell ◽  
Error Control ◽  
Type I Error ◽  
Expression Profiles ◽  
Gene Expression Profiles ◽  
Simulated Data ◽  
Real Data ◽  
Type I ◽  
Rna Seq ◽  
Cell Counts

AbstractAn increasing number of studies are using single-cell RNA-sequencing (scRNA-seq) to characterize the gene expression profiles of individual cells. One common analysis applied to scRNA-seq data involves detecting differentially expressed (DE) genes between cells in different biological groups. However, many experiments are designed such that the cells to be compared are processed in separate plates or chips, meaning that the groupings are confounded with systematic plate effects. This confounding aspect is frequently ignored in DE analyses of scRNA-seq data. In this article, we demonstrate that failing to consider plate effects in the statistical model results in loss of type I error control. A solution is proposed whereby counts are summed from all cells in each plate and the count sums for all plates are used in the DE analysis. This restores type I error control in the presence of plate effects without compromising detection power in simulated data. Summation is also robust to varying numbers and library sizes of cells on each plate. Similar results are observed in DE analyses of real data where the use of count sums instead of single-cell counts improves specificity and the ranking of relevant genes. This suggests that summation can assist in maintaining statistical rigour in DE analyses of scRNA-seq data with plate effects.

Evaluation for estimating of the PDF and the CDF of Generalized Inverted Exponential Distribution with Application in Industry

2020 ◽  
pp. 507-522
Author(s):  
Parisa Torkaman
Keyword(s):  
Least Squares ◽  
Exponential Distribution ◽  
Mean Squared Error ◽  
Weighted Least Squares ◽  
Real Data ◽  
Minimum Variance ◽  
Cumulative Distribution ◽  
Estimation Methods ◽  
Data Set ◽  
Better Than

The generalized inverted exponential distribution is introduced as a lifetime model with good statistical properties. This paper, the estimation of the probability density function and the cumulative distribution function of with five different estimation methods: uniformly minimum variance unbiased(UMVU), maximum likelihood(ML), least squares(LS), weighted least squares (WLS) and percentile(PC) estimators are considered. The performance of these estimation procedures, based on the mean squared error (MSE) by numerical simulations are compared. Simulation studies express that the UMVU estimator performs better than others and when the sample size is large enough the ML and UMVU estimators are almost equivalent and efficient than LS, WLS and PC. Finally, the result using a real data set are analyzed.

scholarly journals Separation of Chromatographic Co-Eluted Compounds by Clustering and by Functional Data Analysis

Metabolites ◽  
2021 ◽  
Vol 11 (4) ◽  
pp. 214
Author(s):  
Aneta Sawikowska ◽  
Anna Piasecka ◽  
Piotr Kachlicki ◽  
Paweł Krajewski
Keyword(s):  
Simulated Data ◽  
Principal Component ◽  
Real Data ◽  
Functional Principal Component Analysis ◽  
Additional Advantage ◽  
Time Alignment ◽  
Peak Separation ◽  
Biological Mixtures ◽  
Overlapping Peaks ◽  
Retention Time Alignment

Peak overlapping is a common problem in chromatography, mainly in the case of complex biological mixtures, i.e., metabolites. Due to the existence of the phenomenon of co-elution of different compounds with similar chromatographic properties, peak separation becomes challenging. In this paper, two computational methods of separating peaks, applied, for the first time, to large chromatographic datasets, are described, compared, and experimentally validated. The methods lead from raw observations to data that can form inputs for statistical analysis. First, in both methods, data are normalized by the mass of sample, the baseline is removed, retention time alignment is conducted, and detection of peaks is performed. Then, in the first method, clustering is used to separate overlapping peaks, whereas in the second method, functional principal component analysis (FPCA) is applied for the same purpose. Simulated data and experimental results are used as examples to present both methods and to compare them. Real data were obtained in a study of metabolomic changes in barley (Hordeum vulgare) leaves under drought stress. The results suggest that both methods are suitable for separation of overlapping peaks, but the additional advantage of the FPCA is the possibility to assess the variability of individual compounds present within the same peaks of different chromatograms.

A cool modality to restore sinus rhythm

2020 ◽  
Vol 41 (Supplement_2) ◽  
Author(s):  
O Yasin ◽  
A Sugrue ◽  
M Van Zyl ◽  
A Ladejobi ◽  
J Tri ◽  
...  
Keyword(s):  
Atrial Fibrillation ◽  
Body Temperature ◽  
Sinus Rhythm ◽  
Animal Experiments ◽  
Funding Source ◽  
Atrial Pacing ◽  
Exact Test ◽  
Chi Squared ◽  
Cool Device ◽  
Atrial Defibrillation

Abstract Background Slowing electrical conduction by cooling the myocardium can be used for defibrillation. We previously demonstrated the efficacy of a small cold device placed in oblique sinus (OS) in terminating atrial fibrillation (AF). However, the parameters needed to achieve effective atrial defibrillation are unknown. Purpose Assess effect of the size of cooled myocardium on frequency of AF termination in acute canine animal models. Methods Sternotomy was performed under general anesthesia in 10 acute canine experiments. AF was induced using rapid atrial pacing and intra-myocardial epinephrine and acetylcholine injections. Once AF sustained for at least 30s, either a cool (7–9°C) or placebo (body temperature) device was placed in the OS. Four device sizes were tested; ½X½, ¾X¾, and 1X1 inch devices and two ¾X¾ inch devices placed side by side simultaneously. Time to AF termination was recorded. Chi-squared or Fisher's exact test were used to compare the frequency of arrhythmia termination with cooling versus placebo. Results A total of 166 applications were performed (89 cool vs 77 placebo) in 10 animal experiments. Overall, AF terminated in 82% of the cooling applications vs. 67.5% of placebo (P=0.03, Figure 1). For the ½X½ inch device 88% of cold applications restored sinus rhythm vs. 63.6% for placebo (P=0.05). The frequency of sinus restoration for cold ¾X¾, 1X1 and two ¾X¾ side by side devices was 86.7%, 83.3% and 70% respectively. Time to sinus restoration when achieved was within three minutes was also not significantly changed. Conclusion Placing a cool device in the oblique sinus can terminate AF and efficacy is not affected by the size of device. Funding Acknowledgement Type of funding source: Private grant(s) and/or Sponsorship. Main funding source(s): MediCool Technologies

scholarly journals A Closed-Form Solution to Planar Feature-Based Registration of LiDAR Point Clouds

2021 ◽  
Vol 10 (7) ◽  
pp. 435
Author(s):  
Yongbo Wang ◽  
Nanshan Zheng ◽  
Zhengfu Bian
Keyword(s):  
Closed Form ◽  
Closed Form Solution ◽  
Simulated Data ◽  
Real Data ◽  
Point Clouds ◽  
Form Solution ◽  
Spatial Transformation ◽  
Dual Quaternions ◽  
Feature Based ◽  
Planar Feature

Since pairwise registration is a necessary step for the seamless fusion of point clouds from neighboring stations, a closed-form solution to planar feature-based registration of LiDAR (Light Detection and Ranging) point clouds is proposed in this paper. Based on the Plücker coordinate-based representation of linear features in three-dimensional space, a quad tuple-based representation of planar features is introduced, which makes it possible to directly determine the difference between any two planar features. Dual quaternions are employed to represent spatial transformation and operations between dual quaternions and the quad tuple-based representation of planar features are given, with which an error norm is constructed. Based on L2-norm-minimization, detailed derivations of the proposed solution are explained step by step. Two experiments were designed in which simulated data and real data were both used to verify the correctness and the feasibility of the proposed solution. With the simulated data, the calculated registration results were consistent with the pre-established parameters, which verifies the correctness of the presented solution. With the real data, the calculated registration results were consistent with the results calculated by iterative methods. Conclusions can be drawn from the two experiments: (1) The proposed solution does not require any initial estimates of the unknown parameters in advance, which assures the stability and robustness of the solution; (2) Using dual quaternions to represent spatial transformation greatly reduces the additional constraints in the estimation process.

scholarly journals Penalized partial least squares for pleiotropy

2021 ◽  
Vol 22 (1) ◽  
Author(s):  
Camilo Broc ◽  
Therese Truong ◽  
Benoit Liquet
Keyword(s):  
Least Squares ◽  
Partial Least Squares ◽  
Association Studies ◽  
A Priori ◽  
Simulated Data ◽  
Real Data ◽  
Genome Wide Association Studies ◽  
Genetic Associations ◽  
Multiple Traits ◽  
Application Fields

Abstract Background The increasing number of genome-wide association studies (GWAS) has revealed several loci that are associated to multiple distinct phenotypes, suggesting the existence of pleiotropic effects. Highlighting these cross-phenotype genetic associations could help to identify and understand common biological mechanisms underlying some diseases. Common approaches test the association between genetic variants and multiple traits at the SNP level. In this paper, we propose a novel gene- and a pathway-level approach in the case where several independent GWAS on independent traits are available. The method is based on a generalization of the sparse group Partial Least Squares (sgPLS) to take into account groups of variables, and a Lasso penalization that links all independent data sets. This method, called joint-sgPLS, is able to convincingly detect signal at the variable level and at the group level. Results Our method has the advantage to propose a global readable model while coping with the architecture of data. It can outperform traditional methods and provides a wider insight in terms of a priori information. We compared the performance of the proposed method to other benchmark methods on simulated data and gave an example of application on real data with the aim to highlight common susceptibility variants to breast and thyroid cancers. Conclusion The joint-sgPLS shows interesting properties for detecting a signal. As an extension of the PLS, the method is suited for data with a large number of variables. The choice of Lasso penalization copes with architectures of groups of variables and observations sets. Furthermore, although the method has been applied to a genetic study, its formulation is adapted to any data with high number of variables and an exposed a priori architecture in other application fields.

scholarly journals Calibration of Camera and Flash LiDAR System with a Triangular Pyramid Target

2021 ◽  
Vol 11 (2) ◽  
pp. 582
Author(s):  
Zean Bu ◽  
Changku Sun ◽  
Peng Wang ◽  
Hang Dong
Keyword(s):  
Simulated Data ◽  
Real Data ◽  
Calibration Method ◽  
Multiple Sensors ◽  
Triangular Pyramid ◽  
World Coordinate System ◽  
Flash Lidar ◽  
Novel Method ◽  
3D Information ◽  
Incremental Validation

Calibration between multiple sensors is a fundamental procedure for data fusion. To address the problems of large errors and tedious operation, we present a novel method to conduct the calibration between light detection and ranging (LiDAR) and camera. We invent a calibration target, which is an arbitrary triangular pyramid with three chessboard patterns on its three planes. The target contains both 3D information and 2D information, which can be utilized to obtain intrinsic parameters of the camera and extrinsic parameters of the system. In the proposed method, the world coordinate system is established through the triangular pyramid. We extract the equations of triangular pyramid planes to find the relative transformation between two sensors. One capture of camera and LiDAR is sufficient for calibration, and errors are reduced by minimizing the distance between points and planes. Furthermore, the accuracy can be increased by more captures. We carried out experiments on simulated data with varying degrees of noise and numbers of frames. Finally, the calibration results were verified by real data through incremental validation and analyzing the root mean square error (RMSE), demonstrating that our calibration method is robust and provides state-of-the-art performance.

scholarly journals Prediction of Fuel Poverty Potential Risk Index Using Six Regression Algorithms: A Case-Study of Chilean Social Dwellings

2021 ◽  
Vol 13 (5) ◽  
pp. 2426
Author(s):  
David Bienvenido-Huertas ◽  
Jesús A. Pulido-Arcas ◽  
Carlos Rubio-Bellido ◽  
Alexis Pérez-Fargallo
Keyword(s):  
Low Income ◽  
Potential Risk ◽  
Energy Use ◽  
Risk Index ◽  
Computing Time ◽  
Simulated Data ◽  
Real Data ◽  
Support Vector ◽  
Energy Poverty ◽  
Regression Algorithms

In recent times, studies about the accuracy of algorithms to predict different aspects of energy use in the building sector have flourished, being energy poverty one of the issues that has received considerable critical attention. Previous studies in this field have characterized it using different indicators, but they have failed to develop instruments to predict the risk of low-income households falling into energy poverty. This research explores the way in which six regression algorithms can accurately forecast the risk of energy poverty by means of the fuel poverty potential risk index. Using data from the national survey of socioeconomic conditions of Chilean households and generating data for different typologies of social dwellings (e.g., form ratio or roof surface area), this study simulated 38,880 cases and compared the accuracy of six algorithms. Multilayer perceptron, M5P and support vector regression delivered the best accuracy, with correlation coefficients over 99.5%. In terms of computing time, M5P outperforms the rest. Although these results suggest that energy poverty can be accurately predicted using simulated data, it remains necessary to test the algorithms against real data. These results can be useful in devising policies to tackle energy poverty in advance.

Sign in / Sign up

Export Citation Format

Share Document