scholarly journals A permutation test and spatial cross-validation approach to assess models of interspecific competition between trees

PLoS ONE ◽  
2020 ◽  
Vol 15 (3) ◽  
pp. e0229930
Author(s):  
David Allen ◽  
Albert Y. Kim
Blood ◽  
2020 ◽  
Vol 136 (Supplement 1) ◽  
pp. 31-32
Author(s):  
Christopher J. Walker ◽  
Yao Shen ◽  
Mariano Alvarez ◽  
Hua Chang ◽  
Jatin Shah ◽  
...  

Introduction: Selinexor is an oral selective inhibitor of XPO1 that was recently approved by the US FDA for treatment of adult patients with relapsed or refractory DLBCL, after at least two lines of systemic therapy. Approval was based on results of the Phase 2b SADAL study, which had an overall response rate of 29% in the primary analysis population (clinicaltrials.gov: NCT02227251). We herein investigated molecular markers of response to selinexor from patients treated on the SADAL study. Methods: Exome sequencing was performed on pre-selinexor treatment biopsies from 55 patients and used to compare mutation frequencies between 21 responder patients (best overall response of complete response [CR], 6; and partial response [PR], 15) and 34 non-responder patients (stable disease [SD], 8; and progressive disease [PD], 26). Additionally, RNA sequencing was performed on a subset of 33 patients and gene expressions were used to infer activities of regulatory proteins with the VIPER algorithm. Differences in inferred protein activities between responder and non-responder patients were assessed using four machine learning algorithms: linear regression (LR), linear discriminant analysis (LDA), ridge regression (RR) and random forest (RF). Model performance was estimated using leave-one-out cross-validation (LOOCV). A separate comparison was performed in the subset of 12 patients with germinal B-cell like (GCB) DLBCL. Results: Our analysis of genes commonly mutated in DLBCL revealed that non-responder patients more frequently harbored mutations in KMT2D (35% non-responders, 14% responders). Examination of the specific types of KMT2D mutations showed that the vast majority were loss-of-function frameshift or nonsense mutations (13 of 15 mutations), indicating they could have functional relevance to disease biology. The activities of 5,742 regulatory proteins were successful inferred from RNA sequencing performed on 33 patients. Unsupervised clustering identified two outlier samples that were removed from further analysis. The remaining 31 patients consisted of 16 responders (CR, 5; and PR, 11) that were compared to 15 non-responders (PD, 15). Dimension reduction of the 5,742 protein activities (filtering proteins with low variation, poor VIPER imputation, and strong linkage) resulted in 680 independent informative regulatory protein activities used for predicting selinexor response. Different numbers of regulatory proteins were iteratively input into the machine learning models to compare responders and non-responders. The best performance model was achieved using only six proteins (ASH1L, ZNF471, RRN3, CD248, ZNF750, INHBA) (Figure 1A), and had an area under the receiver operating characteristic curve (AUC) of 0.917, 0.925, 0.883, and 0.875, for the LDA, LR, RF and RR, models, respectively (p < 0.05, permutation test) (Figure 1B). A final integrated model combining the four methods achieved an AUC = 0.929 (p < 0.05, permutation test, AUC 95% CI: [0.831-1] DeLong non-parametric method) (Figure 1C). Similar results were obtained using 5-fold cross validation with the six-protein activity signature (integrated model AUC = 0.858, AUC 95% CI: [0.72-0.997]). Finally, we focused separately on 12 patients with germinal B-cell like (GCB) DLBCL, (6 responder patients, and 6 non-responder patients). Using LOOCV with the top three protein activities associated with selinexor response in GCB-DLBCL (COL1A1, INHBA, and CNOT2) resulted in remarkably high accuracy, with an integrated model AUC = .972 (p < 0.05, permutation test, AUC 95% CI: [0.895-1]). Discussion and Conclusions: The six proteins used for defining the DLBCL selinexor response signature are not typically associated with a role in DLBCL but have been implicated in cancer biology in other contexts. Notably, INHBA was found as predictor of response in the full set and also the GCB subtype patients, suggesting that activin/inhibin signaling could be important for response to selinexor in patients with DLBCL, especially the GCB subtype. Our results produced a protein activity signature that could be useful for identifying patients with DLBCL likely to respond well to selinexor treatment, which will be validated in a larger independent sample set. Figure 1 Disclosures Walker: Vigeo Therapeutics: Consultancy; Karyopharm: Current Employment, Current equity holder in publicly-traded company. Alvarez:DarwinHealth, Inc: Current Employment, Current equity holder in private company. Chang:Karyopharm Therapeutics Inc: Current Employment. Shah:Karyopharm Therapeutics Inc: Current Employment, Current equity holder in publicly-traded company. Shacham:Karyopharm: Current Employment, Current equity holder in publicly-traded company, Patents & Royalties: (8999996, 9079865, 9714226, PCT/US12/048319, and I574957) on hydrazide containing nuclear transport modulators and uses, and pending patents PCT/US12/048319, 499/2012, PI20102724, and 2012000928) . Califano:DarwinHealth, Inc: Consultancy, Current Employment, Current equity holder in private company, Other: Founder. Landesman:Karyopharm Therapeutics Inc: Current Employment, Current equity holder in publicly-traded company.


Metabolomics ◽  
2021 ◽  
Vol 17 (3) ◽  
Author(s):  
Salah Abdelrazig ◽  
Catharine A. Ortori ◽  
Michael Doherty ◽  
Ana M. Valdes ◽  
Victoria Chapman ◽  
...  

Abstract Introduction Osteoarthritis (OA) is a common cause of disability in older people, but its aetiology is not yet fully understood. Biomarkers of OA from metabolomics studies have shown potential use in understanding the progression and pathophysiology of OA. Objectives To investigate possible surrogate biomarkers of knee OA in urine using metabolomics to contribute towards a better understanding of OA progression and possible targeted treatment. Method Liquid chromatography-high resolution mass spectrometry (LC-HRMS) was applied in a case–control approach to explore the possible metabolic differences between the urinary profiles of symptomatic knee OA patients (n = 74) (subclassified into inflammatory OA, n = 22 and non-inflammatory OA, n = 52) and non-OA controls (n = 68). Univariate, multivariate and pathway analyses were performed with a rigorous validation including cross-validation, permutation test, prediction and receiver operating characteristic curve to identify significantly altered metabolites and pathways in OA. Results OA datasets generated 7405 variables and multivariate analysis showed clear separation of inflammatory OA, but not non-inflammatory OA, from non-OA controls. Adequate cross-validation (R2Y = 0.874, Q2 = 0.465) was obtained. The prediction model and the ROC curve showed satisfactory results with a sensitivity of 88%, specificity of 71% and accuracy of 77%. 26 metabolites were identified as potential biomarkers of inflammatory OA using HMDB, authentic standards and/or MS/MS database. Conclusion Urinary metabolic profiles were altered in inflammatory knee OA subjects compared to those with non-inflammatory OA and non-OA controls. These altered profiles associated with perturbed activity of the TCA cycle, pyruvate and amino acid metabolism linked to inflammation, oxidative stress and collagen destruction. Of note, 2-keto-glutaramic acid level was > eightfold higher in the inflammatory OA patients compared to non-OA control, signalling a possible perturbation in glutamine metabolism related to OA progression.


Author(s):  
Albert Kim ◽  
David Allen ◽  
Simon Couch

1. Neighborhood competition models are powerful tools to measure the effect of interspecific competition. Statistical methods to ease the application of these models are currently lacking. 2. We present the forestecology package providing methods to i) specify neighborhood competition models, ii) evaluate the effect of competitor species identity using permutation tests, and iii) measure model performance using spatial cross-validation. Following Allen (2020), we implement a Bayesian linear regression neighborhood competition model. 3. We demonstrate the package’s functionality using data from the Smithsonian Conservation Biology Institute’s large forest dynamics plot, part of the ForestGEO global network of research sites. Given ForestGEO’s data collection protocols and data formatting standards, the package was designed with cross-site compatibility in mind. We highlight the importance of spatial cross-validation when interpreting model results. 4. The package features i) tidyverse-like structure whereby verb-named functions can be modularly “piped” in sequence, ii) functions with standardized inputs/outputs of simple features ‘sf‘ package class, and iii) an S3 object-oriented implementation of the Bayesian linear regression model. These three facts allow for clear articulation of all the steps in the sequence of analysis and easy wrangling and visualization of the geospatial data. Furthermore, while the package only has Bayesian linear regression implemented, the package was designed with extensibility to other methods in mind.


2015 ◽  
Vol 137 (4) ◽  
Author(s):  
Shun Takai ◽  
Marcos Esterman ◽  
Ashok Midha

This paper proposes an approach to investigate associations between design concepts and design outcomes. In the proposed approach, three deliverables (concept sketches, proof-of-concept (POC) prototypes, and final products) are evaluated using metrics called creative product semantic scale (CPSS). CPSS scores are analyzed using two methods: correlation analysis and classification tree analysis. Correlation analysis is used to investigate associations between the concept sketches or the POC prototypes and the final products. Classification tree analysis (together with leave-one-out cross-validation (LOOCV) and permutation test) is used to investigate relationships between CPSS scores and the retention of design concepts (i.e., concepts that are embodied in the final products). The proposed approach is illustrated using deliverables in a project-based design class.


2011 ◽  
Vol 27 (1) ◽  
pp. 65-70 ◽  
Author(s):  
Marleen M. Rijkeboer ◽  
Huub van den Bergh ◽  
Jan van den Bout

This study examines the construct validity of the Young Schema-Questionnaire at the item level in a Dutch population. Possible bias of items in relation to the presence or absence of psychopathology, gender, and educational level was analyzed, using a cross-validation design. None of the items of the YSQ exhibited differential item functioning (DIF) for gender, and only one item showed DIF for educational level. Furthermore, item bias analysis did not identify DIF for the presence or absence of psychopathology in as much as 195 of the 205 items comprising the YSQ. Ten items, however, spread over the questionnaire, were found to yield relatively inconsistent response patterns for patients and nonclinical participants.


1972 ◽  
Vol 17 (2) ◽  
pp. 85-86
Author(s):  
RICHARD F. Q. JOHNSON
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document