An open-source semi-automated processing chain for urban obia classification

Abstract. A huge amount of legacy drilling data is available in geological survey but cannot be used directly as they are compiled and recorded in an unstructured textual form and using different formats depending on the database structure, company, logging geologist, investigation method, investigated materials and/or drilling campaign. They are subjective and plagued by uncertainty as they are likely to have been conducted by tens to hundreds of geologists, all of whom would have their own personal biases. dh2loop (https://github.com/Loop3D/dh2loop, last access: 30 September 2021) is an open-source Python library for extracting and standardizing geologic drill hole data and exporting them into readily importable interval tables (collar, survey, lithology). In this contribution, we extract, process and classify lithological logs from the Geological Survey of Western Australia (GSWA) Mineral Exploration Reports (WAMEX) database in the Yalgoo–Singleton greenstone belt (YSGB) region. The contribution also addresses the subjective nature and variability of the nomenclature of lithological descriptions within and across different drilling campaigns by using thesauri and fuzzy string matching. For this study case, 86 % of the extracted lithology data is successfully matched to lithologies in the thesauri. Since this process can be tedious, we attempted to test the string matching with the comments, which resulted in a matching rate of 16 % (7870 successfully matched records out of 47 823 records). The standardized lithological data are then classified into multi-level groupings that can be used to systematically upscale and downscale drill hole data inputs for multiscale 3D geological modelling. dh2loop formats legacy data bridging the gap between utilization and maximization of legacy drill hole data and drill hole analysis functionalities available in existing Python libraries (lasio, welly, striplog).

Download Full-text

Decon2LS: An open-source software package for automated processing and visualization of high resolution mass spectrometry data

BMC Bioinformatics ◽

10.1186/1471-2105-10-87 ◽

2009 ◽

Vol 10 (1) ◽

pp. 87 ◽

Cited By ~ 159

Author(s):

Navdeep Jaitly ◽

Anoop Mayampurath ◽

Kyle Littlefield ◽

Joshua N Adkins ◽

Gordon A Anderson ◽

...

Keyword(s):

Mass Spectrometry ◽

High Resolution ◽

Open Source ◽

Open Source Software ◽

Software Package ◽

High Resolution Mass Spectrometry ◽

Mass Spectrometry Data ◽

Open Source Software Package ◽

Automated Processing ◽

Resolution Mass

Download Full-text

AN OPTIMISED SYSTEM FOR GENERATING MULTI-RESOLUTION DTMS USING NASA MRO DATASETS

ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences ◽

10.5194/isprs-archives-xli-b3-115-2016 ◽

2016 ◽

Vol XLI-B3 ◽

pp. 115-121

Author(s):

Y. Tao ◽

J.-P. Muller ◽

P. Sidiropoulos ◽

J. Veitch-Michaelis ◽

V. Yershov

Keyword(s):

Open Source ◽

Cross Correlation ◽

Stereo Matching ◽

Uncertainty Estimation ◽

Confidence Estimation ◽

Registration Accuracy ◽

Processing Chain ◽

Trade Offs ◽

Refinement Method ◽

The Eu

Within the EU FP-7 iMars project, a fully automated multi-resolution DTM processing chain, called Co-registration ASP-Gotcha Optimised (CASP-GO) has been developed, based on the open source NASA Ames Stereo Pipeline (ASP). CASP-GO includes tiepoint based multi-resolution image co-registration and an adaptive least squares correlation-based sub-pixel refinement method called Gotcha. The implemented system guarantees global geo-referencing compliance with respect to HRSC (and thence to MOLA), provides refined stereo matching completeness and accuracy based on the ASP normalised cross-correlation. We summarise issues discovered from experimenting with the use of the open-source ASP DTM processing chain and introduce our new working solutions. These issues include global co-registration accuracy, de-noising, dealing with failure in matching, matching confidence estimation, outlier definition and rejection scheme, various DTM artefacts, uncertainty estimation, and quality-efficiency trade-offs.

Download Full-text

AUTOMATED CALCULATION OF CHARACTERISTICS OF THE CATCHMENT BASIN AS A TOOL OF RUNOFF MODELLING

Interexpo GEO-Siberia ◽

10.33764/2618-981x-2019-4-1-83-89 ◽

2019 ◽

Vol 4 (1) ◽

pp. 83-89

Author(s):

Nikita Baldakov ◽

Alexey Kudishin

Keyword(s):

Open Source ◽

Open Source Software ◽

Catchment Area ◽

Drainage Basin ◽

Heterogeneous Data ◽

Catchment Basin ◽

Automated Processing

The modeling of runoff from the catchment area requires automated processing of a large amount of heterogeneous data. The article presents the results of the development of tools for automating the calculation of the drainage basin characteristics based on open source software.

Download Full-text

Sentinel-1-based flood mapping: a fully automated processing chain

International Journal of Remote Sensing ◽

10.1080/01431161.2016.1192304 ◽

2016 ◽

Vol 37 (13) ◽

pp. 2990-3004 ◽

Cited By ~ 132

Author(s):

André Twele ◽

Wenxi Cao ◽

Simon Plank ◽

Sandro Martinis

Keyword(s):

Flood Mapping ◽

Processing Chain ◽

Automated Processing

Download Full-text

A Sentinel-1 Based Processing Chain for Detection of Cyclonic Flood Impacts

Remote Sensing ◽

10.3390/rs12020252 ◽

2020 ◽

Vol 12 (2) ◽

pp. 252

Author(s):

Cyprien Alexandre ◽

Rosa Johary ◽

Thibault Catry ◽

Pascal Mouquet ◽

Christophe Révillion ◽

...

Keyword(s):

Economic Cost ◽

Future Climate Change ◽

Management Service ◽

Temporal Filtering ◽

Flood Impacts ◽

Processing Chain ◽

Kappa Value ◽

Multi Temporal ◽

Automated Processing ◽

Sentinel 2

In the future, climate change will induce even more severe hurricanes. Not only should these be better understood, but there is also a necessity to improve the assessment of their impacts. Flooding is one of the most common powerful impacts of these storms. Analyzing the impacts of floods is essential in order to delineate damaged areas and study the economic cost of hurricane-related floods. This paper presents an automated processing chain for Sentinel-1 synthetic aperture radar (SAR) data. This processing chain is based on the S1-Tiling algorithm and the normalized difference ratio (NDR). It is able to download and clip S1 images on Sentinel-2 tiles footprints, perform multi-temporal filtering, and threshold NDR images to produce a mask of flooded areas. Applied to two different study zones, subject to hurricanes and cyclones, this chain is reliable and simple to implement. With the rapid mapping product of EMS Copernicus (Emergency Management Service) as reference, the method confers up to 95% accuracy and a Kappa value of 0.75.

Download Full-text

Urban Footprint Processor—Fully Automated Processing Chain Generating Settlement Masks From Global Data of the TanDEM-X Mission

IEEE Geoscience and Remote Sensing Letters ◽

10.1109/lgrs.2013.2272953 ◽

2013 ◽

Vol 10 (6) ◽

pp. 1617-1621 ◽

Cited By ~ 154

Author(s):

T. Esch ◽

M. Marconcini ◽

A. Felbier ◽

A. Roth ◽

W. Heldens ◽

...

Keyword(s):

Processing Chain ◽

Automated Processing ◽

Global Data ◽

Urban Footprint

Download Full-text

3-D interactive visualisation tools for Hispectral line imaging

Proceedings of the International Astronomical Union ◽

10.1017/s174392131700134x ◽

2016 ◽

Vol 12 (S325) ◽

pp. 305-310

Author(s):

J. M. van der Hulst ◽

D. Punzo ◽

J. B. T. M. Roerdink

Keyword(s):

Open Source ◽

Open Source Software ◽

Medical Image ◽

Large Datasets ◽

Qualitative And Quantitative ◽

Comparative Modelling ◽

Open Source Software Package ◽

Automated Processing ◽

Line Imaging ◽

Interactive Visualisation

AbstractUpcoming HI surveys will deliver such large datasets that automated processing using the full 3-D information to find and characterize HI objects is unavoidable. Full 3-D visualization is an essential tool for enabling qualitative and quantitative inspection and analysis of the 3-D data, which is often complex in nature. Here we presentSlicerAstro, an open-source extension of3DSlicer, a multi-platform open source software package for visualization and medical image processing, which we developed for the inspection and analysis of HI spectral line data. We describe its initial capabilities, including 3-D filtering, 3-D selection and comparative modelling.

Download Full-text

AN OPTIMISED SYSTEM FOR GENERATING MULTI-RESOLUTION DTMS USING NASA MRO DATASETS

ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences ◽

10.5194/isprsarchives-xli-b3-115-2016 ◽

2016 ◽

Vol XLI-B3 ◽

pp. 115-121 ◽

Cited By ~ 1

Author(s):

Y. Tao ◽

J.-P. Muller ◽

P. Sidiropoulos ◽

J. Veitch-Michaelis ◽

V. Yershov

Keyword(s):

Open Source ◽

Cross Correlation ◽

Stereo Matching ◽

Uncertainty Estimation ◽

Confidence Estimation ◽

Registration Accuracy ◽

Processing Chain ◽

Trade Offs ◽

Refinement Method ◽

The Eu

Within the EU FP-7 iMars project, a fully automated multi-resolution DTM processing chain, called Co-registration ASP-Gotcha Optimised (CASP-GO) has been developed, based on the open source NASA Ames Stereo Pipeline (ASP). CASP-GO includes tiepoint based multi-resolution image co-registration and an adaptive least squares correlation-based sub-pixel refinement method called Gotcha. The implemented system guarantees global geo-referencing compliance with respect to HRSC (and thence to MOLA), provides refined stereo matching completeness and accuracy based on the ASP normalised cross-correlation. We summarise issues discovered from experimenting with the use of the open-source ASP DTM processing chain and introduce our new working solutions. These issues include global co-registration accuracy, de-noising, dealing with failure in matching, matching confidence estimation, outlier definition and rejection scheme, various DTM artefacts, uncertainty estimation, and quality-efficiency trade-offs.

Download Full-text