Kernel partial correlation: a novel approach to capturing conditional independence in graphical models for noisy data

2018 ◽  
Vol 45 (14) ◽  
pp. 2677-2696
Author(s):  
Jihwan Oh ◽  
Faye Zheng ◽  
R. W. Doerge ◽  
Hyonho Chun
2021 ◽  
Author(s):  
Giovanni Briganti ◽  
Marco Scutari ◽  
Richard J. McNally

Bayesian Networks are probabilistic graphical models that represent conditional independence relationships among variables as a directed acyclic graph (DAG), where edges can be interpreted as causal effects connecting one causal symptom to an effect symptom. These models can help overcome one of the key limitations of partial correlation networks whose edges are undirected. This tutorial aims to introduce Bayesian Networks to identify admissible causal relationships in cross-sectional data, as well as how to estimate these models in R through three algorithm families with an empirical example data set of depressive symptoms. In addition, we discuss common problems and questions related to Bayesian networks. We recommend Bayesian networks be investigated to gain causal insight in psychological data.


Agronomy ◽  
2021 ◽  
Vol 11 (4) ◽  
pp. 761
Author(s):  
Daniel Bravo ◽  
Clara Leon-Moreno ◽  
Carlos Alberto Martínez ◽  
Viviana Marcela Varón-Ramírez ◽  
Gustavo Alfonso Araujo-Carrillo ◽  
...  

This study represents the first nationwide survey regarding the distribution of Cd content in cacao-growing soils in Colombia. The soil Cd distribution was analyzed using a cold/hotspots model. Moreover, both descriptive and predictive analytical tools were used to assess the key factors regulating the Cd concentration, considering Cd content and eight soil variables in the cacao systems. A critical discussion was performed in four main cacao-growing districts. Our results suggest that the performance of a model using all the variables will always be superior to the one using Zn alone. The analyzed variables featured an appropriate predictive performance, nonetheless, that performance has to be improved to develop a prediction method that might be used nationwide. Results from the fitted graphical models showed that the largest associations (as measured by the partial correlation coefficients) were those between Cd and Zn. Ca had the second-largest partial correlation with Cd and its predictive performance ranked second. Interestingly, it was found that there was a high variability in the factors correlated with Cd in cacao growing soils at a national level. Therefore, this study constitutes a baseline for the forthcoming studies in the country and should be reinforced with an analysis of cadmium content in cacao beans.


1996 ◽  
Vol 21 (3) ◽  
pp. 264-282 ◽  
Author(s):  
András Vargha ◽  
Tamás Rudas ◽  
Harold D. Delaney ◽  
Scott E. Maxwell

It was recently demonstrated that performing median splits on both of two predictor variables could sometimes result in spurious statistical significance instead of lower power. Not only is the conventional wisdom that dichotomization always lowers power incorrect, but the current article further demonstrates that inflation of apparent effects can also occur in certain cases where only one of two predictor variables is dichotomized. In addition, we show that previously published formulas claiming that correlations are necessarily reduced by bivariate dichotomization are incorrect. While the magnitude of the difference between the correct and incorrect formulas is not great for small or moderate correlations, it is important to correct the misunderstanding of partial correlations that led to the error in the previous derivations. This is done by considering the relationship between partial correlation and conditional independence in the context of dichotomized predictor variables.


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Vincent Bessonneau ◽  
Roy R. Gerona ◽  
Jessica Trowbridge ◽  
Rachel Grashow ◽  
Thomas Lin ◽  
...  

AbstractGiven the complex exposures from both exogenous and endogenous sources that an individual experiences during life, exposome-wide association studies that interrogate levels of small molecules in biospecimens have been proposed for discovering causes of chronic diseases. We conducted a study to explore associations between environmental chemicals and endogenous molecules using Gaussian graphical models (GGMs) of non-targeted metabolomics data measured in a cohort of California women firefighters and office workers. GGMs revealed many exposure-metabolite associations, including that exposures to mono-hydroxyisononyl phthalate, ethyl paraben and 4-ethylbenzoic acid were associated with metabolites involved in steroid hormone biosynthesis, and perfluoroalkyl substances were linked to bile acids—hormones that regulate cholesterol and glucose metabolism—and inflammatory signaling molecules. Some hypotheses generated from these findings were confirmed by analysis of data from the National Health and Nutrition Examination Survey. Taken together, our findings demonstrate a novel approach to discovering associations between chemical exposures and biological processes of potential relevance for disease causation.


2020 ◽  
Author(s):  
Victor Bernal ◽  
Rainer Bischoff ◽  
Peter Horvatovich ◽  
Victor Guryev ◽  
Marco Grzegorczyk

Abstract Background: In systems biology, it is important to reconstruct regulatory networks from quantitative molecular profiles. Gaussian graphical models (GGMs) are one of the most popular methods to this end. A GGM consists of nodes (representing the transcripts, metabolites or proteins) inter-connected by edges (reflecting their partial correlations). Learning the edges from quantitative molecular profiles is statistically challenging, as there are usually fewer samples than nodes (‘high dimensional problem’). Shrinkage methods address this issue by learning a regularized GGM. However, it is an open question how the shrinkage affects the final result and its interpretation.Results: We show that the shrinkage biases the partial correlation in a non-linear way. This bias does not only change the magnitudes of the partial correlations but also affects their order. Furthermore, it makes networks obtained from different experiments incomparable and hinders their biological interpretation. We propose a method, referred to as the ‘un-shrunk’ partial correlation, which corrects for this non-linear bias. Unlike traditional methods, which use a fixed shrinkage value, the new approach provides partial correlations that are closer to the actual (population) values and that are easier to interpret. We apply the ‘un-shrunk’ method to two gene expression datasets from Escherichia coli and Mus musculus.Conclusions: GGMs are popular undirected graphical models based on partial correlations. The application of GGMs to reconstruct regulatory networks is commonly performed using shrinkage to overcome the “high-dimensional” problem. Besides it advantages, we have identified that the shrinkage introduces a non-linear bias in the partial correlations. Ignoring this type of effects caused by the shrinkage can obscure the interpretation of the network, and impede the validation of earlier reported results.


2021 ◽  
Vol 22 (1) ◽  
Author(s):  
Victor Bernal ◽  
Rainer Bischoff ◽  
Peter Horvatovich ◽  
Victor Guryev ◽  
Marco Grzegorczyk

Abstract Background In systems biology, it is important to reconstruct regulatory networks from quantitative molecular profiles. Gaussian graphical models (GGMs) are one of the most popular methods to this end. A GGM consists of nodes (representing the transcripts, metabolites or proteins) inter-connected by edges (reflecting their partial correlations). Learning the edges from quantitative molecular profiles is statistically challenging, as there are usually fewer samples than nodes (‘high dimensional problem’). Shrinkage methods address this issue by learning a regularized GGM. However, it remains open to study how the shrinkage affects the final result and its interpretation. Results We show that the shrinkage biases the partial correlation in a non-linear way. This bias does not only change the magnitudes of the partial correlations but also affects their order. Furthermore, it makes networks obtained from different experiments incomparable and hinders their biological interpretation. We propose a method, referred to as ‘un-shrinking’ the partial correlation, which corrects for this non-linear bias. Unlike traditional methods, which use a fixed shrinkage value, the new approach provides partial correlations that are closer to the actual (population) values and that are easier to interpret. This is demonstrated on two gene expression datasets from Escherichia coli and Mus musculus. Conclusions GGMs are popular undirected graphical models based on partial correlations. The application of GGMs to reconstruct regulatory networks is commonly performed using shrinkage to overcome the ‘high-dimensional problem’. Besides it advantages, we have identified that the shrinkage introduces a non-linear bias in the partial correlations. Ignoring this type of effects caused by the shrinkage can obscure the interpretation of the network, and impede the validation of earlier reported results.


2019 ◽  
Vol 9 (1) ◽  
Author(s):  
Ginette Lafit ◽  
Francis Tuerlinckx ◽  
Inez Myin-Germeys ◽  
Eva Ceulemans

AbstractGaussian Graphical Models (GGMs) are extensively used in many research areas, such as genomics, proteomics, neuroimaging, and psychology, to study the partial correlation structure of a set of variables. This structure is visualized by drawing an undirected network, in which the variables constitute the nodes and the partial correlations the edges. In many applications, it makes sense to impose sparsity (i.e., some of the partial correlations are forced to zero) as sparsity is theoretically meaningful and/or because it improves the predictive accuracy of the fitted model. However, as we will show by means of extensive simulations, state-of-the-art estimation approaches for imposing sparsity on GGMs, such as the Graphical lasso, ℓ1 regularized nodewise regression, and joint sparse regression, fall short because they often yield too many false positives (i.e., partial correlations that are not properly set to zero). In this paper we present a new estimation approach that allows to control the false positive rate better. Our approach consists of two steps: First, we estimate an undirected network using one of the three state-of-the-art estimation approaches. Second, we try to detect the false positives, by flagging the partial correlations that are smaller in absolute value than a given threshold, which is determined through cross-validation; the flagged correlations are set to zero. Applying this new approach to the same simulated data, shows that it indeed performs better. We also illustrate our approach by using it to estimate (1) a gene regulatory network for breast cancer data, (2) a symptom network of patients with a diagnosis within the nonaffective psychotic spectrum and (3) a symptom network of patients with PTSD.


1996 ◽  
Vol 21 (3) ◽  
pp. 264 ◽  
Author(s):  
András Vargha ◽  
Tamás Rudas ◽  
Harold D. Delaney ◽  
Scott E. Maxwell ◽  
Andras Vargha ◽  
...  

2017 ◽  
Vol 27 (11) ◽  
pp. 3224-3235 ◽  
Author(s):  
Shuang Ji ◽  
Jing Ning ◽  
Jing Qin ◽  
Dean Follmann

Determining conditional dependence is a challenging but important task in both model building and in applications such as genetic association studies and graphical models. Research on this topic has focused on kernel-based methods or has used categorical conditioning variables because of the challenge of the curse of dimensionality. To overcome this challenge, we propose a class of tests for conditional independence without any restriction on the distribution of the conditioning variables. The proposed test statistic can be treated as a generalized weighted Kendall’s tau, in which the generalized odds ratio is utilized as a weight function to account for the distance between different values of the conditioning variables. The test procedure has desirable asymptotic properties and is easy to implement. We evaluate the finite sample performance of the proposed test through simulation studies and illustrate it using two real data examples.


2020 ◽  
Vol 38 (6_suppl) ◽  
pp. 570-570
Author(s):  
Sergiusz Wesolowski ◽  
Roberto Nussenzveig ◽  
Victor Sacristan Santos ◽  
John Esther ◽  
Divyam Goel ◽  
...  

570 Background: AI is increasingly being used in clinical cancer genomics research. Probabilistic Graphical Models (PGMs) are AI algorithms that capture multivariate, mutli-level dependencies in complex patterns in large datasets while retaining human interpretability. We hypothesize that PGMs can identify clinical and genomic features that correlate with IO response in patients (pts) with mUC. Methods: In this retrospective study eligibility criteria were: diagnosis of mUC, receipt of IO for mUC, comprehensive genomic profiling data available from CLIA certified labs. The Bayesian Network (BN, PGM based AI) was used to discover clinical characteristics and selected genomic alterations relevant to IO response by RECIST 1.1 (investigator assessed). Results: Overall, 95 pts (73 men) with mUC were evaluated. 45 (47%) were ever smokers.The presented BN correctly captured the clinical landscape of mUC explaining significant relationship between included variables (p<0.0001). Ever smokers and pts with de novo metastasis had higher TMB and better response to IO. Inactivating MLL2 alterations were more prevalent in non-smokers, and negatively correlated with response to IO. FGFR3 alterations did not predict response to IO. Significant associations are presented in Table. Conclusions: These hypothesis-generating data (by a novel approach, i.e. PGM based AI) showed that smoking and high-TMB were associated with improved response to IO; in contrast, inactivating MLL2 alternations and visceral metastasis predicted inferior response. FGFR3 alterations did not correlate with response. This model validated previous findings and found new hypothesis-generating relationship, such as altered MLL2 gene; external validation is needed.[Table: see text]


Sign in / Sign up

Export Citation Format

Share Document