Optically Enhanced Super-Resolution of Sea Surface Temperature Using Deep Learning

Author(s):  
David T. Lloyd ◽  
Aaron Abela ◽  
Reuben A. Farrugia ◽  
Anthony Galea ◽  
Gianluca Valentino
2021 ◽  
Vol 13 (18) ◽  
pp. 3568
Author(s):  
Bo Ping ◽  
Yunshan Meng ◽  
Cunjin Xue ◽  
Fenzhen Su

Meso- and fine-scale sea surface temperature (SST) is an essential parameter in oceanographic research. Remote sensing is an efficient way to acquire global SST. However, single infrared-based and microwave-based satellite-derived SST cannot obtain complete coverage and high-resolution SST simultaneously. Deep learning super-resolution (SR) techniques have exhibited the ability to enhance spatial resolution, offering the potential to reconstruct the details of SST fields. Current SR research focuses mainly on improving the structure of the SR model instead of training dataset selection. Different from generating the low-resolution images by downscaling the corresponding high-resolution images, the high- and low-resolution SST are derived from different sensors. Hence, the structure similarity of training patches may affect the SR model training and, consequently, the SST reconstruction. In this study, we first discuss the influence of training dataset selection on SST SR performance, showing that the training dataset determined by the structure similarity index (SSIM) of 0.6 can result in higher reconstruction accuracy and better image quality. In addition, in the practical stage, the spatial similarity between the low-resolution input and the objective high-resolution output is a key factor for SST SR. Moreover, the training dataset obtained from the actual AMSR2 and MODIS SST images is more suitable for SST SR because of the skin and sub-skin temperature difference. Finally, the SST reconstruction accuracies obtained from different SR models are relatively consistent, yet the differences in reconstructed image quality are rather significant.


2021 ◽  
Vol 13 (4) ◽  
pp. 744
Author(s):  
J. Xavier Prochaska ◽  
Peter C. Cornillon ◽  
David M. Reiman

We performed an out-of-distribution (OOD) analysis of ∼12,000,000 semi-independent 128 × 128 pixel2 sea surface temperature (SST) regions, which we define as cutouts, from all nighttime granules in the MODIS R2019 Level-2 public dataset to discover the most complex or extreme phenomena at the ocean’s surface. Our algorithm (ULMO) is a probabilistic autoencoder (PAE), which combines two deep learning modules: (1) an autoencoder, trained on ∼150,000 random cutouts from 2010, to represent any input cutout with a 512-dimensional latent vector akin to a (non-linear) Empirical Orthogonal Function (EOF) analysis; and (2) a normalizing flow, which maps the autoencoder’s latent space distribution onto an isotropic Gaussian manifold. From the latter, we calculated a log-likelihood (LL) value for each cutout and defined outlier cutouts to be those in the lowest 0.1% of the distribution. These exhibit large gradients and patterns characteristic of a highly dynamic ocean surface, and many are located within larger complexes whose unique dynamics warrant future analysis. Without guidance, ULMO consistently locates the outliers where the major western boundary currents separate from the continental margin. Prompted by these results, we began the process of exploring the fundamental patterns learned by ULMO thereby identifying several compelling examples. Future work may find that algorithms such as ULMO hold significant potential/promise to learn and derive other, not-yet-identified behaviors in the ocean from the many archives of satellite-derived SST fields. We see no impediment to applying them to other large remote-sensing datasets for ocean science (e.g., SSH and ocean color).


2021 ◽  
Author(s):  
Evangelos Moschos ◽  
Alexandre Stegner ◽  
Olivier Schwander ◽  
Patrick Gallinari

<p>Mesoscale eddies are oceanic vortices with radii of tens of kilometers, which live on for several months or even years. They carry large amounts of heat, salt, nutrients, and pollutants from their regions of formation to remote areas, making it important to detect and track them. Using satellite altimetric maps, mesoscale eddies have been detected via remote sensing with advancing performance over the last years <strong>[1]</strong>. However, the spatio-temporal interpolation between satellite track measurements, needed to produce these maps, induces a limit to the spatial resolution (1/12° in the Med Sea) and large amounts of uncertainty in non-measured areas.</p><p>Nevertheless, mesoscale oceanic eddies also have a visible signature on other satellite imagery such as Sea Surface Temperature (SST), portraying diverse patterns of coherent vortices, temperature gradients, and swirling filaments. Learning the regularities of such signatures defines a challenging pattern recognition task, due to their complex structure but also to the cloud coverage which can corrupt a large fraction of the image.</p><p>We introduce a novel Deep Learning approach to classify sea temperature eddy signatures <strong>[2]</strong>. We create a large dataset of SST patches from satellite imagery in the Mediterranean Sea, containing Anticyclonic, Cyclonic, or No Eddy signatures, based on altimetric eddy detections of the DYNED-Atlas <strong>[3]</strong>. Our trained Convolutional Neural Network (CNN) can differentiate between these signatures with an accuracy of more than 90%, robust to a high level of cloud coverage.</p><p>We furtherly evaluate the efficiency of our classifier on SST patches extracted from oceanographic numerical model outputs in the Mediterranean Sea. Our promising results suggest that the CNN could complement the detection, tracking, and prediction of the path of mesoscale oceanic eddies.</p><p><strong>[1]</strong> <em>Chelton, D. B., Schlax, M. G. and Samelson, R. M. (2011). Global observations of nonlinear mesoscale eddies. Progress in oceanography, 91(2),167-216.</em></p><p><strong>[2]</strong> <em>E. Moschos, A. Stegner, O. Schwander and P. Gallinari, "Classification of Eddy Sea Surface Temperature Signatures Under Cloud Coverage," in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 13, pp. 3437-3447, 2020, doi: 10.1109/JSTARS.2020.3001830.</em></p><p><strong>[3]</strong> <em>https://www.lmd.polytechnique.fr/dyned/</em></p>


2015 ◽  
Vol 12 (17) ◽  
pp. 5229-5245 ◽  
Author(s):  
I. Hernández-Carrasco ◽  
J. Sudre ◽  
V. Garçon ◽  
H. Yahia ◽  
C. Garbe ◽  
...  

Abstract. An accurate quantification of the role of the ocean as source/sink of greenhouse gases (GHGs) requires to access the high-resolution of the GHG air–sea flux at the interface. In this paper we present a novel method to reconstruct maps of surface ocean partial pressure of CO2 ( pCO2) and air–sea CO2 fluxes at super resolution (4 km, i.e., 1/32° at these latitudes) using sea surface temperature (SST) and ocean color (OC) data at this resolution, and CarbonTracker CO2 fluxes data at low resolution (110 km). Inference of super-resolution pCO2 and air–sea CO2 fluxes is performed using novel nonlinear signal processing methodologies that prove efficient in the context of oceanography. The theoretical background comes from the microcanonical multifractal formalism which unlocks the geometrical determination of cascading properties of physical intensive variables. As a consequence, a multi-resolution analysis performed on the signal of the so-called singularity exponents allows for the correct and near optimal cross-scale inference of GHG fluxes, as the inference suits the geometric realization of the cascade. We apply such a methodology to the study offshore of the Benguela area. The inferred representation of oceanic partial pressure of CO2 improves and enhances the description provided by CarbonTracker, capturing the small-scale variability. We examine different combinations of ocean color and sea surface temperature products in order to increase the number of valid points and the quality of the inferred pCO2 field. The methodology is validated using in situ measurements by means of statistical errors. We find that mean absolute and relative errors in the inferred values of pCO2 with respect to in situ measurements are smaller than for CarbonTracker.


2020 ◽  
Author(s):  
Pavan Kumar Jonnakuti ◽  
Udaya Bhaskar Tata Venkata Sai

<p>Sea surface temperature (SST) is a key variable of the global ocean, which affects air-sea interaction processes. Forecasts based on statistics and machine learning techniques did not succeed in considering the spatial and temporal relationships of the time series data. Therefore, to achieve precision in SST prediction we propose a deep learning-based model, by which we can produce a more realistic and accurate account of SST ‘behavior’ as it focuses both on space and time. Our hybrid CNN-LSTM model uses multiple processing layers to learn hierarchical representations by implementing 3D and 2D convolution neural networks as a method to better understand the spatial features and additionally we use LSTM to examine the temporal sequence of relations in SST time-series satellite data. Widespread studies, based on the historical satellite datasets spanning from 1980 - present time, in Indian Ocean region shows that our proposed deep learning-based CNN-LSTM model is extremely capable for short and mid-term daily SST prediction accurately exclusive based on the error estimates (obtained from LSTM) of the forecasted data sets.</p><p><strong>Keywords: Deep Learning, Sea Surface Temperature, CNN, LSTM, Prediction.</strong></p><p> </p>


2020 ◽  
Vol 6 (29) ◽  
pp. eaba1482
Author(s):  
Gang Zheng ◽  
Xiaofeng Li ◽  
Rong-Hua Zhang ◽  
Bin Liu

Forecasting fields of oceanic phenomena has long been dependent on physical equation–based numerical models. The challenge is that many natural processes need to be considered for understanding complicated phenomena. In contrast, rules of the processes are already embedded in the time-series observation itself. Thus, inspired by largely available satellite remote sensing data and the advance of deep learning technology, we developed a purely satellite data–driven deep learning model for forecasting the sea surface temperature evolution associated with a typical phenomenon: a tropical instability wave. During the testing period of 9 years (2010–2019), our model accurately and efficiently forecasts the sea surface temperature field. This study demonstrates the strong potential of the satellite data–driven deep learning model as an alternative to traditional numerical models for forecasting oceanic phenomena.


Sign in / Sign up

Export Citation Format

Share Document