scholarly journals Large Area High-Resolution 3D Mapping of Oxia Planum: The Landing Site for the ExoMars Rosalind Franklin Rover

2021 ◽  
Vol 13 (16) ◽  
pp. 3270
Author(s):  
Yu Tao ◽  
Jan-Peter Muller ◽  
Susan J. Conway ◽  
Siting Xiong

We demonstrate an end-to-end application of the in-house deep learning-based surface modelling system, called MADNet, to produce three large area 3D mapping products from single images taken from the ESA Mars Express’s High Resolution Stereo Camera (HRSC), the NASA Mars Reconnaissance Orbiter’s Context Camera (CTX), and the High Resolution Imaging Science Experiment (HiRISE) imaging data over the ExoMars 2022 Rosalind Franklin rover’s landing site at Oxia Planum on Mars. MADNet takes a single orbital optical image as input, provides pixelwise height predictions, and uses a separate coarse Digital Terrain Model (DTM) as reference, to produce a DTM product from the given input image. Initially, we demonstrate the resultant 25 m/pixel HRSC DTM mosaic covering an area of 197 km × 182 km, providing fine-scale details to the 50 m/pixel HRSC MC-11 level-5 DTM mosaic. Secondly, we demonstrate the resultant 12 m/pixel CTX MADNet DTM mosaic covering a 114 km × 117 km area, showing much more detail in comparison to photogrammetric DTMs produced using the open source in-house developed CASP-GO system. Finally, we demonstrate the resultant 50 cm/pixel HiRISE MADNet DTM mosaic, produced for the first time, covering a 74.3 km × 86.3 km area of the 3-sigma landing ellipse and partially the ExoMars team’s geological characterisation area. The resultant MADNet HiRISE DTM mosaic shows fine-scale details superior to existing Planetary Data System (PDS) HiRISE DTMs and covers a larger area that is considered difficult for existing photogrammetry and photoclinometry pipelines to achieve, especially given the current limitations of stereo HiRISE coverage. All of the resultant DTM mosaics are co-aligned with each other, and ultimately with the Mars Global Surveyor’s Mars Orbiter Laser Altimeter (MOLA) DTM, providing high spatial and vertical congruence. In this paper, technical details are presented, issues that arose are discussed, along with a visual evaluation and quantitative assessments of the resultant DTM mosaic products.

2021 ◽  
Vol 13 (15) ◽  
pp. 2877
Author(s):  
Yu Tao ◽  
Siting Xiong ◽  
Susan J. Conway ◽  
Jan-Peter Muller ◽  
Anthony Guimpier ◽  
...  

The lack of adequate stereo coverage and where available, lengthy processing time, various artefacts, and unsatisfactory quality and complexity of automating the selection of the best set of processing parameters, have long been big barriers for large-area planetary 3D mapping. In this paper, we propose a deep learning-based solution, called MADNet (Multi-scale generative Adversarial u-net with Dense convolutional and up-projection blocks), that avoids or resolves all of the above issues. We demonstrate the wide applicability of this technique with the ExoMars Trace Gas Orbiter Colour and Stereo Surface Imaging System (CaSSIS) 4.6 m/pixel images on Mars. Only a single input image and a coarse global 3D reference are required, without knowing any camera models or imaging parameters, to produce high-quality and high-resolution full-strip Digital Terrain Models (DTMs) in a few seconds. In this paper, we discuss technical details of the MADNet system and provide detailed comparisons and assessments of the results. The resultant MADNet 8 m/pixel CaSSIS DTMs are qualitatively very similar to the 1 m/pixel HiRISE DTMs. The resultant MADNet CaSSIS DTMs display excellent agreement with nested Mars Reconnaissance Orbiter Context Camera (CTX), Mars Express’s High-Resolution Stereo Camera (HRSC), and Mars Orbiter Laser Altimeter (MOLA) DTMs at large-scale, and meanwhile, show fairly good correlation with the High-Resolution Imaging Science Experiment (HiRISE) DTMs for fine-scale details. In addition, we show how MADNet outperforms traditional photogrammetric methods, both on speed and quality, for other datasets like HRSC, CTX, and HiRISE, without any parameter tuning or re-training of the model. We demonstrate the results for Oxia Planum (the landing site of the European Space Agency’s Rosalind Franklin ExoMars rover 2023) and a couple of sites of high scientific interest.


2021 ◽  
Vol 13 (21) ◽  
pp. 4220
Author(s):  
Yu Tao ◽  
Jan-Peter Muller ◽  
Siting Xiong ◽  
Susan J. Conway

The High-Resolution Imaging Science Experiment (HiRISE) onboard the Mars Reconnaissance Orbiter provides remotely sensed imagery at the highest spatial resolution at 25–50 cm/pixel of the surface of Mars. However, due to the spatial resolution being so high, the total area covered by HiRISE targeted stereo acquisitions is very limited. This results in a lack of the availability of high-resolution digital terrain models (DTMs) which are better than 1 m/pixel. Such high-resolution DTMs have always been considered desirable for the international community of planetary scientists to carry out fine-scale geological analysis of the Martian surface. Recently, new deep learning-based techniques that are able to retrieve DTMs from single optical orbital imagery have been developed and applied to single HiRISE observational data. In this paper, we improve upon a previously developed single-image DTM estimation system called MADNet (1.0). We propose optimisations which we collectively call MADNet 2.0, which is based on a supervised image-to-height estimation network, multi-scale DTM reconstruction, and 3D co-alignment processes. In particular, we employ optimised single-scale inference and multi-scale reconstruction (in MADNet 2.0), instead of multi-scale inference and single-scale reconstruction (in MADNet 1.0), to produce more accurate large-scale topographic retrieval with boosted fine-scale resolution. We demonstrate the improvements of the MADNet 2.0 DTMs produced using HiRISE images, in comparison to the MADNet 1.0 DTMs and the published Planetary Data System (PDS) DTMs over the ExoMars Rosalind Franklin rover’s landing site at Oxia Planum. Qualitative and quantitative assessments suggest the proposed MADNet 2.0 system is capable of producing pixel-scale DTM retrieval at the same spatial resolution (25 cm/pixel) of the input HiRISE images.


Author(s):  
R. L. Kirk ◽  
R. L. Fergason ◽  
B. Redding ◽  
D. Galuszka ◽  
E. Smith ◽  
...  

Abstract. We have used a high-precision, high-resolution digital terrain model (DTM) of the NASA Mars 2020 rover Perseverance landing site in Jezero crater based on mosaicked images from the Mars Reconnaissance Orbiter High Resolution Imaging Science Experiment (MRO HiRISE) camera as a reference dataset to evaluate DTMs based on Mars Express High Resolution Stereo Camera (MEX HRSC) and MRO Context camera (CTX) images. Results are consistent with our earlier HRSC-HiRISE comparisons at the Mars Science Laboratory (MSL) Curiosity landing site in Gale crater, confirming that those results were not compromised by the small area compared and potential problems with spatial registration. Specifically, height errors are on the order of half a pixel and correspond to an image matching error of 0.2–0.3 pixel but estimates of horizontal resolution are 10–20 pixels. Products from the HRSC team pipeline at DLR are smoother but more precise vertically than those produced by using the commercial stereo package SOCET SET®. The DLR products are also homogenous in quality, whereas the SOCET products are less smoothed and have higher errors in rougher terrain. Despite this weak variation, our results are consistent with a rule of thumb of 0.2–0.3 pixel matching precision based on many prior studies. Horizontal resolution is significantly coarser than the DTM ground sample distance (GSD), which is typically 3–5 pixels.


Author(s):  
R. L. Kirk ◽  
E. Howington-Kraus ◽  
K. Edmundson ◽  
B. Redding ◽  
D. Galuszka ◽  
...  

The High Resolution Stereo Camera (HRSC) on the Mars Express orbiter (Neukum et al. 2004) is a multi-line pushbroom scanner that can obtain stereo and color coverage of targets in a single overpass, with pixel scales as small as 10&amp;thinsp;m at periapsis. Since commencing operations in 2004 it has imaged ~&amp;thinsp;77&amp;thinsp;% of Mars at 20&amp;thinsp;m/pixel or better. The instrument team uses the Video Image Communication And Retrieval (VICAR) software to produce and archive a range of data products from uncalibrated and radiometrically calibrated images to controlled digital topographic models (DTMs) and orthoimages and regional mosaics of DTM and orthophoto data (Gwinner et al. 2009; 2010b; 2016). Alternatives to this highly effective standard processing pipeline are nevertheless of interest to researchers who do not have access to the full VICAR suite and may wish to make topographic products or perform other (e. g., spectrophotometric) analyses prior to the release of the highest level products. We have therefore developed software to ingest HRSC images and model their geometry in the USGS Integrated Software for Imagers and Spectrometers (ISIS3), which can be used for data preparation, geodetic control, and analysis, and the commercial photogrammetric software SOCET SET (® BAE Systems; Miller and Walker 1993; 1995) which can be used for independent production of DTMs and orthoimages. <br><br> The initial implementation of this capability utilized the then-current ISIS2 system and the generic pushbroom sensor model of SOCET SET, and was described in the DTM comparison of independent photogrammetric processing by different elements of the HRSC team (Heipke et al. 2007). A major drawback of this prototype was that neither software system then allowed for pushbroom images in which the exposure time changes from line to line. Except at periapsis, HRSC makes such timing changes every few hundred lines to accommodate changes of altitude and velocity in its elliptical orbit. As a result, it was necessary to split observations into blocks of constant exposure time, greatly increasing the effort needed to control the images and collect DTMs. <br><br> Here, we describe a substantially improved HRSC processing capability that incorporates sensor models with varying line timing in the current ISIS3 system (Sides 2017) and SOCET SET. This enormously reduces the work effort for processing most images and eliminates the artifacts that arose from segmenting them. In addition, the software takes advantage of the continuously evolving capabilities of ISIS3 and the improved image matching module NGATE (Next Generation Automatic Terrain Extraction, incorporating area and feature based algorithms, multi-image and multi-direction matching) of SOCET SET, thus greatly reducing the need for manual editing of DTM errors. We have also developed a procedure for geodetically controlling the images to Mars Orbiter Laser Altimeter (MOLA) data by registering a preliminary stereo topographic model to MOLA by using the point cloud alignment (<i>pc_align</i>) function of the NASA Ames Stereo Pipeline (ASP; Moratto et al. 2010). This effectively converts inter-image tiepoints into ground control points in the MOLA coordinate system. The result is improved absolute accuracy and a significant reduction in work effort relative to manual measurement of ground control. <i>The ISIS and ASP software used are freely available; SOCET SET, is a commercial product.</i> By the end of 2017 we expect to have ported our SOCET SET HRSC sensor model to the Community Sensor Model (CSM; Community Sensor Model Working Group 2010; Hare and Kirk 2017) standard utilized by the successor photogrammetric system SOCET GXP that is currently offered by BAE. In early 2018, we are also working with BAE to release the CSM source code under a BSD or MIT open source license. <br><br> We illustrate current HRSC processing capabilities with three examples, of which the first two come from the DTM comparison of 2007. Candor Chasma (h1235_0001) was a near-periapse observation with constant exposure time that could be processed relatively easily at that time. We show qualitative and quantitative improvements in DTM resolution and precision as well as greatly reduced need for manual editing, and illustrate some of the photometric applications possible in ISIS. At the Nanedi Valles site we are now able to process all 3 long-arc orbits (h0894_0000, h0905_0000 and h0927_0000) without segmenting the images. Finally, processing image set h4235_0001, which covers the landing site of the Mars Science Laboratory (MSL) rover and its rugged science target of Aeolus Mons in Gale crater, provides a rare opportunity to evaluate DTM resolution and precision because extensive High Resolution Imaging Science Experiment (HiRISE) DTMs are available (Golombek et al. 2012). The HiRISE products have ~&amp;thinsp;50x smaller pixel scale so that discrepancies can mostly be attributed to HRSC. We use the HiRISE DTMs to compare the resolution and precision of our HRSC DTMs with the (evolving) standard products. <br><br> We find that the vertical precision of HRSC DTMs is comparable to the pixel scale but the horizontal resolution may be 15&amp;ndash;30 image pixels, depending on processing. This is significantly coarser than the lower limit of 3&amp;ndash;5 pixels based on the minimum size for image patches to be matched. Stereo DTMs registered to MOLA altimetry by surface fitting typically deviate by 10thinsp;m or less in mean elevation. Estimates of the RMS deviation are strongly influenced by the sparse sampling of the altimetry, but range from <thinsp;50thinsp;m in flat areas to ~&amp;thinsp;100thinsp;m in rugged areas.


2014 ◽  
Vol 23 (7) ◽  
pp. 1016 ◽  
Author(s):  
E. Louise Loudermilk ◽  
Gary L. Achtemeier ◽  
Joseph J. O'Brien ◽  
J. Kevin Hiers ◽  
Benjamin S. Hornsby

In ecosystems with frequent surface fires, fire and fuel heterogeneity at relevant scales have been largely ignored. This could be because complete burns give an impression of homogeneity, or due to the difficulty in capturing fine-scale variation in fuel characteristics and fire behaviour. Fire movement between patches of fuel can have implications for modelling fire spread and understanding ecological effects. We collected high resolution (0.8×0.8-cm pixels) visual and thermal imaging data during fire passage over 4×4-m plots of mixed fuel beds consisting of pine litter and grass during two prescribed burns within the longleaf pine forests of Eglin Air Force Base, FL in February 2011. Fuel types were identified by passing multi-spectral digital images through a colour recognition algorithm in ‘Rabbit Rules,’ an experimental coupled fire-atmosphere fire spread model. Image fuel types were validated against field fuel types. Relationships between fuel characteristics and fire behaviour measurements at multiple resolutions (0.8×0.8cm to 33×33cm) were analysed using a regression tree approach. There were strong relationships between fire behaviour and fuels, especially at the 33×33-cm scale (R2=0.40–0.69), where image-to-image overlap error was reduced and fuels were well characterised. Distinct signatures were found for individual and coupled fuel types for determining fire behaviour, illustrating the importance of understanding fire-fuel heterogeneity at fine-scales. Simulating fire spread at this fine-scale may be critical for understanding fire effects, such as understorey plant community assembly.


2022 ◽  
Vol 14 (2) ◽  
pp. 257
Author(s):  
Yu Tao ◽  
Siting Xiong ◽  
Jan-Peter Muller ◽  
Greg Michael ◽  
Susan J. Conway ◽  
...  

We propose using coupled deep learning based super-resolution restoration (SRR) and single-image digital terrain model (DTM) estimation (SDE) methods to produce subpixel-scale topography from single-view ESA Trace Gas Orbiter Colour and Stereo Surface Imaging System (CaSSIS) and NASA Mars Reconnaissance Orbiter High Resolution Imaging Science Experiment (HiRISE) images. We present qualitative and quantitative assessments of the resultant 2 m/pixel CaSSIS SRR DTM mosaic over the ESA and Roscosmos Rosalind Franklin ExoMars rover’s (RFEXM22) planned landing site at Oxia Planum. Quantitative evaluation shows SRR improves the effective resolution of the resultant CaSSIS DTM by a factor of 4 or more, while achieving a fairly good height accuracy measured by root mean squared error (1.876 m) and structural similarity (0.607), compared to the ultra-high-resolution HiRISE SRR DTMs at 12.5 cm/pixel. We make available, along with this paper, the resultant CaSSIS SRR image and SRR DTM mosaics, as well as HiRISE full-strip SRR images and SRR DTMs, to support landing site characterisation and future rover engineering for the RFEXM22.


2020 ◽  
Author(s):  
Yu Tao ◽  
Jan-Peter Muller ◽  
Susan Conway

&lt;p&gt;Recurring Slope Lineae (RSLs) are metre- to decametre-wide dark streaks found on steep slopes, which lengthen downslope during the warmest times of the year, fading during the cooler periods and reappearing again in the next Martian year. This behaviour has been linked to the action of liquid water, but as liquid water is thermodynamically unstable under current martian conditions this interpretation is under vigorous debate. A better understanding of the formation process of RSLs is therefore fundamental to constraining Mars&amp;#8217; water budget and habitability. One of the key components for studying the RSL process is accurate knowledge of the slopes and aspects.&lt;/p&gt;&lt;p&gt;&amp;#160;&lt;/p&gt;&lt;p&gt;The Valles Marineris (VM) area has the highest concentration of RSLs found on Mars as well as being a location where the triple point of water can be reached during the Martian summertime. This study focuses on multi-resolution 3D mapping of the whole VM area with all digital terrain models (DTMs) vertically referenced to the global standard Mars Orbiter Laser Altimeter (MOLA) surface. A multi-resolution DTM has been generated consisting of 82 Mars Express High Resolution Camera (HRSC) 50m DTMs and 1763 Mars Reconnaissance Orbiter (MRO) Context Camera (CTX) 18m DTMs which will be presented. For 3 selected study areas (Coprates Montes, Capri Mensa, Nectaris Montes), terrain corrected and co-registered MRO High Resolution Imaging Science Experiment (HiRISE; at 0.25m), Compact Reconnaissance Imaging Spectrometer for Mars (CRISM; at 20/50m) and ExoMars Trace Gas Orbiter (TGO) Colour and Stereo Surface Imaging System (CaSSIS; at 2.5m) colour images and associated DTMs will be discussed.&lt;/p&gt;&lt;p&gt;&amp;#160;&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Acknowledgements&lt;/strong&gt;&lt;/p&gt;&lt;p&gt;The research leading to these results is receiving funding from the UKSA Aurora programme (2018-2021) under grant no. ST/S001891/1.&lt;/p&gt;


Author(s):  
Russell L. Steere

Complementary replicas have revealed the fact that the two common faces observed in electron micrographs of freeze-fracture and freeze-etch specimens are complementary to each other and are thus the new faces of a split membrane rather than the original inner and outer surfaces (1, 2 and personal observations). The big question raised by published electron micrographs is why do we not see depressions in the complementary face opposite membrane-associated particles? Reports have appeared indicating that some depressions do appear but complementarity on such a fine scale has yet to be shown.Dog cardiac muscle was perfused with glutaraldehyde, washed in distilled water, then transferred to 30% glycerol (material furnished by Dr. Joaquim Sommer, Duke Univ., and VA Hospital, Durham, N.C.). Small strips were freeze-fractured in a Denton Vacuum DFE-2 Freeze-Etch Unit with complementary replica tooling. Replicas were cleaned in chromic acid cleaning solution, then washed in 4 changes of distilled water and mounted on opposite sides of the center wire of a Formvar-coated grid.


Author(s):  
W. Lo ◽  
J.C.H. Spence ◽  
M. Kuwabara

Work on the integration of STM with REM has demonstrated the usefulness of this combination. The STM has been designed to replace the side entry holder of a commercial Philips 400T TEM. It allows simultaneous REM imaging of the tip/sample region of the STM (see fig. 1). The REM technique offers nigh sensitivity to strain (<10−4) through diffraction contrast and high resolution (<lnm) along the unforeshortened direction. It is an ideal technique to use for studying tip/surface interactions in STM.The elastic strain associated with tunnelling was first imaged on cleaved, highly doped (S doped, 5 × 1018cm-3) InP(110). The tip and surface damage observed provided strong evidence that the strain was caused by tip/surface contact, most likely through an insulating adsorbate layer. This is consistent with the picture that tunnelling in air, liquid or ordinary vacuum (such as in a TEM) occurs through a layer of contamination. The tip, under servo control, must compress the insulating contamination layer in order to get close enough to the sample to tunnel. The contaminant thereby transmits the stress to the sample. Elastic strain while tunnelling from graphite has been detected by others, but never directly imaged before. Recent results using the STM/REM combination has yielded the first direct evidence of strain while tunnelling from graphite. Figure 2 shows a graphite surface elastically strained by the STM tip while tunnelling (It=3nA, Vtip=−20mV). Video images of other graphite surfaces show a reversible strain feature following the tip as it is scanned. The elastic strain field is sometimes seen to extend hundreds of nanometers from the tip. Also commonly observed while tunnelling from graphite is an increase in the RHEED intensity of the scanned region (see fig.3). Debris is seen on the tip and along the left edges of the brightened scan region of figure 4, suggesting that tip abrasion of the surface has occurred. High resolution TEM images of other tips show what appear to be attached graphite flakes. The removal of contamination, possibly along with the top few layers of graphite, seems a likely explanation for the observed increase in RHEED reflectivity. These results are not inconsistent with the “sliding planes” model of tunnelling on graphite“. Here, it was proposed that the force due to the tunnelling probe acts over a large area, causing shear of the graphite planes when the tip is scanned. The tunneling current is then modulated as the planes of graphite slide in and out of registry. The possiblity of true vacuum tunnelling from the cleaned graphite surface has not been ruled out. STM work function measurements are needed to test this.


1996 ◽  
Vol 451 ◽  
Author(s):  
T. Shimizu ◽  
M. Murahara

ABSTRACTA Fluorocarbon resin surface was selectively modified by irradiation with a ArF laser beam through a thin layer of NaAlO2, B(OH)3, or H2O solution to give a hydrophilic property. As a result, with low fluence, the surface was most effectively modified with the NaAlO2 solution among the three solutions. However, the contact angle in this case changed by 10 degrees as the fluence changed only 1mJ/cm2. When modifying a large area of the surface, high resolution displacement could not be achieved because the laser beam was not uniform in displacing functional groups. Thus, the laser fluence was successfully made uniform by homogenizing the laser beam; the functional groups were replaced on the fluorocarbon resin surface with high resolution, which was successfully modified to be hydrophilic by distributing the laser fluence uniformly.


Sign in / Sign up

Export Citation Format

Share Document