scholarly journals Rapid Single Image-Based DTM Estimation from ExoMars TGO CaSSIS Images Using Generative Adversarial U-Nets

2021 ◽  
Vol 13 (15) ◽  
pp. 2877
Author(s):  
Yu Tao ◽  
Siting Xiong ◽  
Susan J. Conway ◽  
Jan-Peter Muller ◽  
Anthony Guimpier ◽  
...  

The lack of adequate stereo coverage and where available, lengthy processing time, various artefacts, and unsatisfactory quality and complexity of automating the selection of the best set of processing parameters, have long been big barriers for large-area planetary 3D mapping. In this paper, we propose a deep learning-based solution, called MADNet (Multi-scale generative Adversarial u-net with Dense convolutional and up-projection blocks), that avoids or resolves all of the above issues. We demonstrate the wide applicability of this technique with the ExoMars Trace Gas Orbiter Colour and Stereo Surface Imaging System (CaSSIS) 4.6 m/pixel images on Mars. Only a single input image and a coarse global 3D reference are required, without knowing any camera models or imaging parameters, to produce high-quality and high-resolution full-strip Digital Terrain Models (DTMs) in a few seconds. In this paper, we discuss technical details of the MADNet system and provide detailed comparisons and assessments of the results. The resultant MADNet 8 m/pixel CaSSIS DTMs are qualitatively very similar to the 1 m/pixel HiRISE DTMs. The resultant MADNet CaSSIS DTMs display excellent agreement with nested Mars Reconnaissance Orbiter Context Camera (CTX), Mars Express’s High-Resolution Stereo Camera (HRSC), and Mars Orbiter Laser Altimeter (MOLA) DTMs at large-scale, and meanwhile, show fairly good correlation with the High-Resolution Imaging Science Experiment (HiRISE) DTMs for fine-scale details. In addition, we show how MADNet outperforms traditional photogrammetric methods, both on speed and quality, for other datasets like HRSC, CTX, and HiRISE, without any parameter tuning or re-training of the model. We demonstrate the results for Oxia Planum (the landing site of the European Space Agency’s Rosalind Franklin ExoMars rover 2023) and a couple of sites of high scientific interest.

2021 ◽  
Vol 13 (16) ◽  
pp. 3270
Author(s):  
Yu Tao ◽  
Jan-Peter Muller ◽  
Susan J. Conway ◽  
Siting Xiong

We demonstrate an end-to-end application of the in-house deep learning-based surface modelling system, called MADNet, to produce three large area 3D mapping products from single images taken from the ESA Mars Express’s High Resolution Stereo Camera (HRSC), the NASA Mars Reconnaissance Orbiter’s Context Camera (CTX), and the High Resolution Imaging Science Experiment (HiRISE) imaging data over the ExoMars 2022 Rosalind Franklin rover’s landing site at Oxia Planum on Mars. MADNet takes a single orbital optical image as input, provides pixelwise height predictions, and uses a separate coarse Digital Terrain Model (DTM) as reference, to produce a DTM product from the given input image. Initially, we demonstrate the resultant 25 m/pixel HRSC DTM mosaic covering an area of 197 km × 182 km, providing fine-scale details to the 50 m/pixel HRSC MC-11 level-5 DTM mosaic. Secondly, we demonstrate the resultant 12 m/pixel CTX MADNet DTM mosaic covering a 114 km × 117 km area, showing much more detail in comparison to photogrammetric DTMs produced using the open source in-house developed CASP-GO system. Finally, we demonstrate the resultant 50 cm/pixel HiRISE MADNet DTM mosaic, produced for the first time, covering a 74.3 km × 86.3 km area of the 3-sigma landing ellipse and partially the ExoMars team’s geological characterisation area. The resultant MADNet HiRISE DTM mosaic shows fine-scale details superior to existing Planetary Data System (PDS) HiRISE DTMs and covers a larger area that is considered difficult for existing photogrammetry and photoclinometry pipelines to achieve, especially given the current limitations of stereo HiRISE coverage. All of the resultant DTM mosaics are co-aligned with each other, and ultimately with the Mars Global Surveyor’s Mars Orbiter Laser Altimeter (MOLA) DTM, providing high spatial and vertical congruence. In this paper, technical details are presented, issues that arose are discussed, along with a visual evaluation and quantitative assessments of the resultant DTM mosaic products.


2022 ◽  
Vol 14 (2) ◽  
pp. 257
Author(s):  
Yu Tao ◽  
Siting Xiong ◽  
Jan-Peter Muller ◽  
Greg Michael ◽  
Susan J. Conway ◽  
...  

We propose using coupled deep learning based super-resolution restoration (SRR) and single-image digital terrain model (DTM) estimation (SDE) methods to produce subpixel-scale topography from single-view ESA Trace Gas Orbiter Colour and Stereo Surface Imaging System (CaSSIS) and NASA Mars Reconnaissance Orbiter High Resolution Imaging Science Experiment (HiRISE) images. We present qualitative and quantitative assessments of the resultant 2 m/pixel CaSSIS SRR DTM mosaic over the ESA and Roscosmos Rosalind Franklin ExoMars rover’s (RFEXM22) planned landing site at Oxia Planum. Quantitative evaluation shows SRR improves the effective resolution of the resultant CaSSIS DTM by a factor of 4 or more, while achieving a fairly good height accuracy measured by root mean squared error (1.876 m) and structural similarity (0.607), compared to the ultra-high-resolution HiRISE SRR DTMs at 12.5 cm/pixel. We make available, along with this paper, the resultant CaSSIS SRR image and SRR DTM mosaics, as well as HiRISE full-strip SRR images and SRR DTMs, to support landing site characterisation and future rover engineering for the RFEXM22.


2020 ◽  
Author(s):  
Yu Tao ◽  
Jan-Peter Muller ◽  
Susan Conway

<p>Recurring Slope Lineae (RSLs) are metre- to decametre-wide dark streaks found on steep slopes, which lengthen downslope during the warmest times of the year, fading during the cooler periods and reappearing again in the next Martian year. This behaviour has been linked to the action of liquid water, but as liquid water is thermodynamically unstable under current martian conditions this interpretation is under vigorous debate. A better understanding of the formation process of RSLs is therefore fundamental to constraining Mars’ water budget and habitability. One of the key components for studying the RSL process is accurate knowledge of the slopes and aspects.</p><p> </p><p>The Valles Marineris (VM) area has the highest concentration of RSLs found on Mars as well as being a location where the triple point of water can be reached during the Martian summertime. This study focuses on multi-resolution 3D mapping of the whole VM area with all digital terrain models (DTMs) vertically referenced to the global standard Mars Orbiter Laser Altimeter (MOLA) surface. A multi-resolution DTM has been generated consisting of 82 Mars Express High Resolution Camera (HRSC) 50m DTMs and 1763 Mars Reconnaissance Orbiter (MRO) Context Camera (CTX) 18m DTMs which will be presented. For 3 selected study areas (Coprates Montes, Capri Mensa, Nectaris Montes), terrain corrected and co-registered MRO High Resolution Imaging Science Experiment (HiRISE; at 0.25m), Compact Reconnaissance Imaging Spectrometer for Mars (CRISM; at 20/50m) and ExoMars Trace Gas Orbiter (TGO) Colour and Stereo Surface Imaging System (CaSSIS; at 2.5m) colour images and associated DTMs will be discussed.</p><p> </p><p><strong>Acknowledgements</strong></p><p>The research leading to these results is receiving funding from the UKSA Aurora programme (2018-2021) under grant no. ST/S001891/1.</p>


2021 ◽  
Vol 13 (11) ◽  
pp. 2185
Author(s):  
Yu Tao ◽  
Sylvain Douté ◽  
Jan-Peter Muller ◽  
Susan J. Conway ◽  
Nicolas Thomas ◽  
...  

We introduce a novel ultra-high-resolution Digital Terrain Model (DTM) processing system using a combination of photogrammetric 3D reconstruction, image co-registration, image super-resolution restoration, shape-from-shading DTM refinement, and 3D co-alignment methods. Technical details of the method are described, and results are demonstrated using a 4 m/pixel Trace Gas Orbiter Colour and Stereo Surface Imaging System (CaSSIS) panchromatic image and an overlapping 6 m/pixel Mars Reconnaissance Orbiter Context Camera (CTX) stereo pair to produce a 1 m/pixel CaSSIS Super-Resolution Restoration (SRR) DTM for different areas over Oxia Planum on Mars—the future ESA ExoMars 2022 Rosalind Franklin rover’s landing site. Quantitative assessments are made using profile measurements and the counting of resolvable craters, in comparison with the publicly available 1 m/pixel High-Resolution Imaging Experiment (HiRISE) DTM. These assessments demonstrate that the final resultant 1 m/pixel CaSSIS DTM from the proposed processing system has achieved comparable and sometimes more detailed 3D reconstruction compared to the overlapping HiRISE DTM.


2021 ◽  
Vol 12 (1) ◽  
Author(s):  
Peipei Du ◽  
Jinghui Li ◽  
Liang Wang ◽  
Liang Sun ◽  
Xi Wang ◽  
...  

AbstractWith rapid advances of perovskite light-emitting diodes (PeLEDs), the large-scale fabrication of patterned PeLEDs towards display panels is of increasing importance. However, most state-of-the-art PeLEDs are fabricated by solution-processed techniques, which are difficult to simultaneously achieve high-resolution pixels and large-scale production. To this end, we construct efficient CsPbBr3 PeLEDs employing a vacuum deposition technique, which has been demonstrated as the most successful route for commercial organic LED displays. By carefully controlling the strength of the spatial confinement in CsPbBr3 film, its radiative recombination is greatly enhanced while the nonradiative recombination is suppressed. As a result, the external quantum efficiency (EQE) of thermally evaporated PeLED reaches 8.0%, a record for vacuum processed PeLEDs. Benefitting from the excellent uniformity and scalability of the thermal evaporation, we demonstrate PeLED with a functional area up to 40.2 cm2 and a peak EQE of 7.1%, representing one of the most efficient large-area PeLEDs. We further achieve high-resolution patterned perovskite film with 100 μm pixels using fine metal masks, laying the foundation for potential display applications. We believe the strategy of confinement strength regulation in thermally evaporated perovskites provides an effective way to process high-efficiency and large-area PeLEDs towards commercial display panels.


2021 ◽  
Author(s):  
Nicolas Mangold ◽  
Livio Tornabene ◽  
Susan Conway ◽  
Anthony Guimpier ◽  
Axel Noblet ◽  
...  

<p>Antoniadi basin is a 330 km diameter Noachian basin localized in the East of Arabia Terra that contains a network of ridges with a tree-like organization. Branched ridges, such as these can form by a variety of processes including the inversion of fluvial deposits, thus potentially highlighting aqueous processes of interest for understanding Mars’ climate evolution. Here, we test this hypothesis by analyzing in details data from Colour and Stereo Surface Imaging System (CaSSIS), High Resolution Imaging Science Experiment (HiRISE) and High Resolution Stereo Camera (HRSC).</p><p>Branched ridges are up to 10 km long and from 10 to 200 m wide without obvious organization in width. The branched ridges texture is rubbly with the occurrence of blocks up to ~1 m in size and a complete lack of layering. A HiRISE elevation model shows the local slope is of 0.2° toward South, and thus contrary to the apparent network organization (assuming tributary flows). There is no indication of exhumation of these ridges from layers below the current plains surface. Our observations are not consistent with the interpretation of digitate landforms such as inverted channels: (i) The rubbly texture lacking any layering at meter scale is distinct from inverted channels as observed elsewhere on Mars. (ii) Heads of presumed inverted channels display a lobate shape unlike river springs. (iii) There is no increase in width from small branches toward North as expected for channels with increasing discharge rates downstream. (iv) The slope toward South is contrary to the inferred flow direction to the North. The detailed analysis of these branched ridges shows many characteristics difficult to reconcile with inverted channels formed by fluvial channels flowing northward. Subglacial drainages are known to locally flow against topography, but they are rarely dendritic.<strong> </strong>Assuming that deposition occurred along the current slope, thus from North to South, the organization of the network requires a control by distributary channels rather than tributary ones. Distributary channels are possible for fluvial flows, but generally limited to braiding regimes or deltaic deposits, of which no further evidence is observed here. The lobate digitate shapes of the degree 1 branches are actually more in line with deposits of viscous flows, thus as terminal branches. Such an interpretation is consistent with lava or mudflows that formed along the current topography. The next step in this study will be to determine more precisely the rheology of these unusual flows.</p><p><strong>Acknowledgments:</strong> French authors are supported by the CNES. The authors wish to thank the spacecraft and instrument engineering teams. CaSSIS is a project of the University of Bern and funded through the Swiss Space Office via ESA’s PRODEX. The instrument hardware development was also supported by the Italian Space Agency (ASI) (agreement no. I/018/12/0), INAF/Astronomical Observatory of Padova, and the Space Research Center (CBK) in Warsaw. Support from SGF (Budapest), the Univ. of Arizona (Lunar and Planet. Lab.) and NASA are gratefully acknowledged.</p>


2021 ◽  
Vol 13 (21) ◽  
pp. 4220
Author(s):  
Yu Tao ◽  
Jan-Peter Muller ◽  
Siting Xiong ◽  
Susan J. Conway

The High-Resolution Imaging Science Experiment (HiRISE) onboard the Mars Reconnaissance Orbiter provides remotely sensed imagery at the highest spatial resolution at 25–50 cm/pixel of the surface of Mars. However, due to the spatial resolution being so high, the total area covered by HiRISE targeted stereo acquisitions is very limited. This results in a lack of the availability of high-resolution digital terrain models (DTMs) which are better than 1 m/pixel. Such high-resolution DTMs have always been considered desirable for the international community of planetary scientists to carry out fine-scale geological analysis of the Martian surface. Recently, new deep learning-based techniques that are able to retrieve DTMs from single optical orbital imagery have been developed and applied to single HiRISE observational data. In this paper, we improve upon a previously developed single-image DTM estimation system called MADNet (1.0). We propose optimisations which we collectively call MADNet 2.0, which is based on a supervised image-to-height estimation network, multi-scale DTM reconstruction, and 3D co-alignment processes. In particular, we employ optimised single-scale inference and multi-scale reconstruction (in MADNet 2.0), instead of multi-scale inference and single-scale reconstruction (in MADNet 1.0), to produce more accurate large-scale topographic retrieval with boosted fine-scale resolution. We demonstrate the improvements of the MADNet 2.0 DTMs produced using HiRISE images, in comparison to the MADNet 1.0 DTMs and the published Planetary Data System (PDS) DTMs over the ExoMars Rosalind Franklin rover’s landing site at Oxia Planum. Qualitative and quantitative assessments suggest the proposed MADNet 2.0 system is capable of producing pixel-scale DTM retrieval at the same spatial resolution (25 cm/pixel) of the input HiRISE images.


Author(s):  
Y. S. Sun ◽  
L. Zhang ◽  
B. Xu ◽  
Y. Zhang

The accurate positioning of optical satellite image without control is the precondition for remote sensing application and small/medium scale mapping in large abroad areas or with large-scale images. In this paper, aiming at the geometric features of optical satellite image, based on a widely used optimization method of constraint problem which is called Alternating Direction Method of Multipliers (ADMM) and RFM least-squares block adjustment, we propose a GCP independent block adjustment method for the large-scale domestic high resolution optical satellite image – GISIBA (GCP-Independent Satellite Imagery Block Adjustment), which is easy to parallelize and highly efficient. In this method, the virtual "average" control points are built to solve the rank defect problem and qualitative and quantitative analysis in block adjustment without control. The test results prove that the horizontal and vertical accuracy of multi-covered and multi-temporal satellite images are better than 10 m and 6 m. Meanwhile the mosaic problem of the adjacent areas in large area DOM production can be solved if the public geographic information data is introduced as horizontal and vertical constraints in the block adjustment process. Finally, through the experiments by using GF-1 and ZY-3 satellite images over several typical test areas, the reliability, accuracy and performance of our developed procedure will be presented and studied in this paper.


Author(s):  
Y. Wang ◽  
B. Wu

The surface slopes of planetary bodies are important factors for exploration missions, such as landing site selection and rover manoeuvre. Generally, high-resolution digital elevation models (DEMs) such as those generated from the HiRISE images on Mars are preferred to generate detailed slopes with a better fidelity of terrain features. Unfortunately, high-resolution datasets normally only cover small area and are not always available. While lower resolution datasets, such as MOLA, provide global coverage of the Martian surface. Slopes generated from the low-resolution DEM will be based on a large baseline and be smoothed from the real situation. In order to carry out slope analysis at large scale on Martian surface based low-resolution data such as MOLA data, while alleviating the smoothness problem of slopes due to its low resolution, this paper presents an amplifying function of slopes derived from low-resolution DEMs based on the relationships between DEM resolutions and slopes. First, slope maps are derived from the HiRISE DEM (meter-level resolution DEM generated from HiRISE images) and a series of down-sampled HiRISE DEMs. The latter are used to simulate low-resolution DEMs. Then the high-resolution slope map is down- sampled to the same resolution with the slope map from the lower-resolution DEMs. Thus, a comparison can be conducted pixel-wise. For each pixel on the slope map derived from the lower-resolution DEM, it can reach the same value with the down-sampled HiRISE slope by multiplying an amplifying factor. Seven sets of HiRISE images with representative terrain types are used for correlation analysis. It shows that the relationship between the amplifying factors and the original MOLA slopes can be described by the exponential function. Verifications using other datasets show that after applying the proposed amplifying function, the updated slope maps give better representations of slopes on Martian surface compared with the original slopes.


2021 ◽  
Author(s):  
Anthony Guimpier ◽  
Susan Conway ◽  
Maurizio Pajola ◽  
Alice Lucchetti ◽  
Emanuele Simioni ◽  
...  

<p>Landslides are common features on the surface of Mars. They have morphologies that resemble debris slides, mudflows [1], or giant rock avalanches [e.g., 2] on Earth. They can mobilise large quantities of material up to 10<sup>12</sup> m<sup>3</sup> and spread over areas of up to 10<sup>9</sup> m<sup>2</sup> [e.g., 3].</p><p>The topography before the landslide event occurred is required to both estimate the volume of mobilised material and quantify the distribution and thickness of the deposit. The mass distribution of the deposit can also be used to compare with 3D flow simulations of landslides [e.g. 1, 3]. However, on Mars there are no landslides that have known topographic data before the event occurred, hence we have to rely on topographic reconstruction.</p><p>This type of reconstruction, which we have already carried out using HiRISE (High Resolution Imaging Science Experiment) Digital Elevation Models (DEM) with 1-2 m vertical resolution [e.g., 1], has never been undertaken using DEMs with 4-5 m vertical resolution derived from CaSSIS (Colour and Stereo Surface Imaging System) stereo pairs [4]. CaSSIS uses a 180° camera rotation to capture stereo images of a given site in a single pass. DEMs are then generated using 3DPD (three Dimensional reconstruction of Planetary Data) software [5].</p><p>Our aim is to test whether a landslide reconstruction can be carried out with a CaSSIS DEM. For our purpose we use a 6 km long landslide in Baetis Chaos region, Mars.</p><p>Our reconstruction consists of three main steps: 1) We first calculate contour lines. 2) Reconstructed contour lines are then drawn by connecting contour lines on either side of the boundary taking into account the overall topography outside the landslide. 3) Then, the reconstructed contour lines are converted into points at intervals equal to the spatial resolution of the DEM. These points are then interpolated using a natural neighbour algorithm to calculate a new DEM without the landslide. We were able to estimate that the landslide in Baetis Chaos has a volume of 10<sup>8</sup> m<sup>3</sup> and the deposit has a maximum thickness of 200 m using CaSSIS data.</p><p>Our successful reconstruction using a CaSSIS DEM increases the potential coverage of high-resolution stereo-topographic data beyond those already available with CTX and/or HiRISE. The resolution CaSSIS DEMs fills a gap in the topographic data currently available for studying landslides. Landslides > 15 km long can be studied with MOLA or HRSC data, and landslides < 5 km long can be studied using HiRISE data. Now, landslides and other landforms 5-15 km can be studied using CaSSIS data with equivalent quality to CTX stereo-topography.</p><p>Acknowledgement: CaSSIS is a project of the University of Bern, with instrument hardware development supported by INAF/Astronomical Observatory of Padova (ASI-INAF agreement n.2020-17-HH.0), and the Space Research Center (CBK) in Warsaw.</p><p>References: [1] A. Guimpier et al. (In review) <em>PSS</em>. [2] G. Magnarini et al. (2019) <em>Nature Communications</em>. [3] G.B. Crosta et al. (2018) <em>ESS</em>, 5, 89–119. [4] A. Lucas et al. (2014) <em>Nature Communications</em>. [5] E. Simioni et al. (In press) <em>PSS</em>.</p>


Sign in / Sign up

Export Citation Format

Share Document