scholarly journals A user-friendly tool for cloud-based whole slide image segmentation, with examples from renal histopathology

2021 ◽  
Author(s):  
Brendon R Lutnick ◽  
David Manthey ◽  
Jan U Becker ◽  
Brandon Ginley ◽  
Katharina Moos ◽  
...  

Image-based machine learning tools hold great promise for clinical applications in nephropathology and kidney research. However, the ideal end-users of these computational tools (e.g., pathologists and biological scientists) often face prohibitive challenges in using these tools to their full potential, including the lack of technical expertise, suboptimal user interface, and limited computation power. We have developed Histo-Cloud, a tool for segmentation of whole slide images (WSIs) that has an easy-to-use graphical user interface. This tool runs a state-of-the-art convolutional neural network (CNN) for segmentation of WSIs in the cloud and allows the extraction of features from segmented regions for further analysis. By segmenting glomeruli, interstitial fibrosis and tubular atrophy, and vascular structures from renal and non-renal WSIs, we demonstrate the scalability, best practices for transfer learning, and effects of dataset variability. Finally, we demonstrate an application for animal model research, analyzing glomerular features in murine models of aging, diabetic nephropathy, and HIV associated nephropathy. The ability to access this tool over the internet will facilitate widespread use by computational non-experts. Histo-Cloud is open source and adaptable for segmentation of any histological structure regardless of stain. Histo-Cloud will greatly accelerate and facilitate the generation of datasets for machine learning in the analysis of kidney histology, empowering computationally novice end-users to conduct deep feature analysis of tissue slides.

2021 ◽  
Author(s):  
Brendon Lutnick ◽  
David Manthey ◽  
Jan Becker ◽  
Brandon Ginley ◽  
Katharina Moos ◽  
...  

Abstract We have developed Histo-Cloud, a tool for segmentation of whole slide images (WSIs) that has an easy-to-use graphical user interface. This tool runs a state-of-the-art convolutional neural network (CNN) for segmentation of WSIs in the cloud and allows the extraction of features from segmented regions for further analysis. By segmenting glomeruli, interstitial fibrosis and tubular atrophy, and vascular structures from renal and non-renal WSIs, we demonstrate the scalability, best practices for transfer learning, and effects of dataset variability. Finally, we demonstrate an application for animal model research, analyzing glomerular features in murine models of aging, diabetic nephropathy, and HIV associated nephropathy. The ability to access this tool over the internet will facilitate widespread use by computational non-experts. Histo-Cloud is open source and adaptable for segmentation of any histological structure regardless of stain.


Kidney360 ◽  
2021 ◽  
pp. 10.34067/KID.0003662021
Author(s):  
Chanon Chantaduly ◽  
Hayden R. Troutt ◽  
Karla A. Perez Reyes ◽  
Jonathan E. Zuckerman ◽  
Peter D. Chang ◽  
...  

Background: The goal of the Artificial Intelligence in Renal Scarring (AIRS) study is to develop machine learning tools for non-invasive quantification of kidney fibrosis from imaging scans. Methods: We conducted a retrospective analysis of patients who had one or more abdominal computed tomography (CT) scans within 6 months of a kidney biopsy. The final cohort encompassed 152 CT scans from 92 patients which included images of 300 native kidneys and 76 transplant kidneys. Two different convolutional neural networks (slice-level and voxel-level classifiers) were tested to differentiate severe vs mild/moderate kidney fibrosis (≥50% vs <50%). Interstitial fibrosis and tubular atrophy scores from kidney biopsy reports were used as ground-truth. Results: The two machine learning models demonstrated similar positive predictive value (0.886 vs 0.935) and accuracy (0.831 vs 0.879). Conclusions: In summary, machine learning algorithms are a promising non-invasive diagnostic tool to quantify kidney fibrosis from CT scans. The clinical utility of these prediction tools, in terms of avoiding renal biopsy and associated bleeding risks in patients with severe fibrosis, remains to be validated in prospective clinical trials.


2021 ◽  
Author(s):  
Marc Labriffe ◽  
Jean-Baptiste Woillard ◽  
Wilfried Gwinner ◽  
Jan-Hinrich Braesen ◽  
Dany Anglicheau ◽  
...  

AbstractBackgroundThe Banff classification standardizes the diagnoses of kidney transplant rejection based on histological criteria. Clinical decisions are generally made after integration of the Banff diagnoses in the clinical context. However, interpretation of the biopsy cases is still heterogeneous among pathologists or clinicians. Machine Learning (ML) algorithms may be trained from expertly assessed cases to provide clinical decision support.MethodsThe ML technique of Extreme Gradient Boosting learned from two large training datasets from the European programs BIOMARGIN and ROCKET (n= 631 and 304), in which biopsies were read centrally and consensually interpreted by a group of experts and used as a reference for untargeted biomarker screenings. The model was then externally validated in three independent datasets (n= 3744, 589 and 360).ResultsIn the three validation datasets, the algorithm yielded a ROC curve AUC of mean (95% CI) 0.97 (0.92-1.00), 0.97 (0.96-0.97) and 0.95 (0.93-0.97) for antibody-mediated rejection (ABMR); 0.94 (0.91-0.96), 0.94 (0.92-0.95) and 0.91 (0.88-0.95) for T cell-mediated rejection; >0.96 (0.90-1.00) in all three for interstitial fibrosis - tubular atrophy (IFTA). Finally, using the largest validation cohort, we developed an additional algorithm to discriminate active and chronic active ABMR with an accuracy of 0.95.ConclusionWe built an Artificial Intelligence algorithm able to interpret histological lesions together with a few routine clinical data with very high sensitivity and specificity. This algorithm should be useful in routine or clinical trials to help pathologists and clinicians and increase biopsy interpretation homogeneity.


2021 ◽  
Vol 36 (Supplement_1) ◽  
Author(s):  
Francesco Fontana ◽  
Filippo Monelli ◽  
Alessia Piccinini ◽  
Giulia Besutti ◽  
Valeria Trojani ◽  
...  

Abstract Background and Aims Interstitial fibrosis / tubular atrophy (IFTA) is a common, irreversible and progressive form of chronic allograft injury, and it is considered a critical predictor of kidney allograft outcomes. Inflammation, both microvascular and interstitial, is on the contrary regarded as a reversible form of graft injury. Since treatments for rejection and other causes of graft dysfunction bear substantial toxicity and could have limited efficacy, the extent of irreversible graft scarring is a crucial information for the clinician, to evaluate risks and benefits of specific therapies. The diagnosis of kidney graft pathology is acquired through graft biopsy, which is an invasive procedure and can be subjected to sampling bias. Magnetic resonance imaging (MRI), especially with functional techniques, has emerged as a possibility for non-invasive estimation of tissue fibrosis; nevertheless, functional MRI is not widely available. Texture analysis MRI (TA-MRI) is a radiomic technique that provides a quantitative assessment of tissue heterogeneity from standard MRI images, generating features that can be fitted into a machine-learning model to assess their ability to predict clinical or histological parameters. Method Single-center cross-sectional observational cohort study enrolling kidney transplant recipients who underwent graft biopsy and graft MRI imaging within 6 months from biopsy, both on clinical indication, at the “Azienda Ospedaliero-Universitaria di Modena”, Italy. The study was approved by the local Ethical Committee (AOU0010167/20). The primary outcome was to identify the best TA-MRI features subset for estimation of IFTA &gt; 50% in graft biopsy. Secondary outcomes were estimation of: IFTA &gt; 25%, presence of total inflammation (ti) and microvascular inflammation (glomerulitis + peritubular capillaritis [g+ptc]). Graft biopsy was reported according to Banff 2017 system. Radiomic analysis was performed on axial T2 pre-contrast and T1 fat-suppressed post-contrast sequences. The whole renal parenchyma (PAR) was segmented and labelled on T2 and T1, renal cortex (COR) only on T2. After imaging preprocessing, PyRadiomics was used to extract radiomic features. After removal of shape features, 93 features were included and reduced using LASSO regression to produce radiomic signatures. These were introduced in Machine Learning (ML) models to test the association with outcomes. Results are reported as AUC and a value of sensitivity and specificity. Results Sixty patients were included in the study, and 67 graft biopsy – graft MRI pairs were available for analysis. Demographic and clinical characteristics of enrolled patients are depicted in table 1; histological diagnosis and main Banff histological parameters from graft biopsies in table 2. Among ML models, three showed an acceptable performance. T2 COR “firstorder_minimum/firstorder_range/glrlm_run_entropy” for IFTA&gt;50% (AUC=0.77, sensitivity=73%, specificity=71%), T1 PAR “firstorder_energy” for IFTA&gt;25% (AUC=0.71, sensitivity=74%, specificity=51%), T1 PAR “firstorder_energy/gldm_small_dependence_low_gray_level_emphasis” for g+ptc &gt;0 (AUC=0.74, sensitivity= 78%, specificity=68%); see figures 1–3. No acceptable prediction was detected for ti &gt;0. Conclusion Our study shows that TA-MRI feature signatures can predict the degree of IFTA in graft biopsies, with an acceptable diagnostic performance. These results suggest to further investigating TA-MRI from standard MRI sequences as potential tool to assess graft chronic parenchymal injury. Moreover, since graft biopsy results can be jeopardized by limited sample size, we hypothesize that evaluation of IFTA through TA-MRI could provide more comprehensive information regarding the whole parenchyma. To test this hypothesis, we are currently evaluating the association of TA-MRI radiomic features and baseline eGFR and eGFR variation over time.


2020 ◽  
Author(s):  
Jingbai Li ◽  
Patrick Reiser ◽  
André Eberhard ◽  
Pascal Friederich ◽  
Steven Lopez

<p>Photochemical reactions are being increasingly used to construct complex molecular architectures with mild and straightforward reaction conditions. Computational techniques are increasingly important to understand the reactivities and chemoselectivities of photochemical isomerization reactions because they offer molecular bonding information along the excited-state(s) of photodynamics. These photodynamics simulations are resource-intensive and are typically limited to 1–10 picoseconds and 1,000 trajectories due to high computational cost. Most organic photochemical reactions have excited-state lifetimes exceeding 1 picosecond, which places them outside possible computational studies. Westermeyr <i>et al.</i> demonstrated that a machine learning approach could significantly lengthen photodynamics simulation times for a model system, methylenimmonium cation (CH<sub>2</sub>NH<sub>2</sub><sup>+</sup>).</p><p>We have developed a Python-based code, Python Rapid Artificial Intelligence <i>Ab Initio</i> Molecular Dynamics (PyRAI<sup>2</sup>MD), to accomplish the unprecedented 10 ns <i>cis-trans</i> photodynamics of <i>trans</i>-hexafluoro-2-butene (CF<sub>3</sub>–CH=CH–CF<sub>3</sub>) in 3.5 days. The same simulation would take approximately 58 years with ground-truth multiconfigurational dynamics. We proposed an innovative scheme combining Wigner sampling, geometrical interpolations, and short-time quantum chemical trajectories to effectively sample the initial data, facilitating the adaptive sampling to generate an informative and data-efficient training set with 6,232 data points. Our neural networks achieved chemical accuracy (mean absolute error of 0.032 eV). Our 4,814 trajectories reproduced the S<sub>1</sub> half-life (60.5 fs), the photochemical product ratio (<i>trans</i>: <i>cis</i> = 2.3: 1), and autonomously discovered a pathway towards a carbene. The neural networks have also shown the capability of generalizing the full potential energy surface with chemically incomplete data (<i>trans</i> → <i>cis</i> but not <i>cis</i> → <i>trans</i> pathways) that may offer future automated photochemical reaction discoveries.</p>


2019 ◽  
Vol 7 (4) ◽  
pp. 184-190
Author(s):  
Himani Maheshwari ◽  
Pooja Goswami ◽  
Isha Rana

2021 ◽  
Vol 192 ◽  
pp. 103181
Author(s):  
Jagadish Timsina ◽  
Sudarshan Dutta ◽  
Krishna Prasad Devkota ◽  
Somsubhra Chakraborty ◽  
Ram Krishna Neupane ◽  
...  

i-com ◽  
2021 ◽  
Vol 20 (1) ◽  
pp. 19-32
Author(s):  
Daniel Buschek ◽  
Charlotte Anlauff ◽  
Florian Lachner

Abstract This paper reflects on a case study of a user-centred concept development process for a Machine Learning (ML) based design tool, conducted at an industry partner. The resulting concept uses ML to match graphical user interface elements in sketches on paper to their digital counterparts to create consistent wireframes. A user study (N=20) with a working prototype shows that this concept is preferred by designers, compared to the previous manual procedure. Reflecting on our process and findings we discuss lessons learned for developing ML tools that respect practitioners’ needs and practices.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Muhammad Javed Iqbal ◽  
Zeeshan Javed ◽  
Haleema Sadia ◽  
Ijaz A. Qureshi ◽  
Asma Irshad ◽  
...  

AbstractArtificial intelligence (AI) is the use of mathematical algorithms to mimic human cognitive abilities and to address difficult healthcare challenges including complex biological abnormalities like cancer. The exponential growth of AI in the last decade is evidenced to be the potential platform for optimal decision-making by super-intelligence, where the human mind is limited to process huge data in a narrow time range. Cancer is a complex and multifaced disorder with thousands of genetic and epigenetic variations. AI-based algorithms hold great promise to pave the way to identify these genetic mutations and aberrant protein interactions at a very early stage. Modern biomedical research is also focused to bring AI technology to the clinics safely and ethically. AI-based assistance to pathologists and physicians could be the great leap forward towards prediction for disease risk, diagnosis, prognosis, and treatments. Clinical applications of AI and Machine Learning (ML) in cancer diagnosis and treatment are the future of medical guidance towards faster mapping of a new treatment for every individual. By using AI base system approach, researchers can collaborate in real-time and share knowledge digitally to potentially heal millions. In this review, we focused to present game-changing technology of the future in clinics, by connecting biology with Artificial Intelligence and explain how AI-based assistance help oncologist for precise treatment.


2021 ◽  
Vol 59 ◽  
pp. 102353
Author(s):  
Amber Grace Young ◽  
Ann Majchrzak ◽  
Gerald C. Kane

Sign in / Sign up

Export Citation Format

Share Document