scholarly journals Using self-organising maps to explore ozone profile validation results – SCIAMACHY limb compared to ground-based lidar observations

2015 ◽  
Vol 8 (5) ◽  
pp. 1951-1963
Author(s):  
J. A. E. van Gijsel ◽  
R. Zurita-Milla ◽  
P. Stammes ◽  
S. Godin-Beekmann ◽  
T. Leblanc ◽  
...  
Keyword(s):  
Zenith Angle ◽  
Solar Zenith Angle ◽  
A Priori ◽  
Relative Difference ◽  
Data Sets ◽  
Full Time ◽  
Data Set ◽  
Partial Correlations ◽  
The Difference ◽  
Ground Based Lidar

Abstract. Traditional validation of atmospheric profiles is based on the intercomparison of two or more data sets in predefined ranges or classes of a given observational characteristic such as latitude or solar zenith angle. In this study we trained a self-organising map (SOM) with a full time series of relative difference profiles of SCIAMACHY limb v5.02 and lidar ozone profiles from seven observation sites. Each individual observation characteristic was then mapped to the obtained SOM to investigate to which degree variation in this characteristic is explanatory for the variation seen in the SOM map. For the studied data sets, altitude-dependent relations for the global data set were found between the difference profiles and studied variables. From the lowest altitude studied (18 km) ascending, the most influencing factors were found to be longitude, followed by solar zenith angle and latitude, sensor age and again solar zenith angle together with the day of the year at the highest altitudes studied here (up to 45 km). After accounting for both latitude and longitude, residual partial correlations with a reduced magnitude are seen for various factors. However, (partial) correlations cannot point out which (combination) of the factors drives the observed differences between the ground-based and satellite ozone profiles as most of the factors are inter-related. Clustering into three classes showed that there are also some local dependencies, with for instance one cluster having a much stronger correlation with the sensor age (days since launch) between 36 and 42 km. The proposed SOM-based approach provides a powerful tool for the exploration of differences between data sets without being limited to a priori defined data subsets.

scholarly journals Using self organising maps to explore ozone profile validation results – SCIAMACHY limb compared to ground-based lidar observations

2014 ◽  
Vol 7 (4) ◽  
pp. 4373-4406
Author(s):  
J. A. E. van Gijsel ◽  
R. Zurita-Milla ◽  
P. Stammes ◽  
S. Godin-Beekmann ◽  
T. Leblanc ◽  
...  
Keyword(s):  
Zenith Angle ◽  
Solar Zenith Angle ◽  
A Priori ◽  
Relative Difference ◽  
Full Time ◽  
Self Organizing Map ◽  
Ozone Profile ◽  
The Difference ◽  
Ground Based Lidar ◽  
Lidar Observations

Abstract. Traditional validation of atmospheric profiles is based on the intercomparison of two or more datasets in predefined ranges or classes of a given observational characteristic such as latitude or solar zenith angle. In this study we train a self organizing map (SOM) with a full time series of relative difference profiles of SCIAMACHY limb v5.02 and lidar ozone profiles from seven observation sites. Each individual observation characteristic is then mapped to the obtained SOM to investigate to which degree variation in this characteristic is explanatory for the variation seen in the SOM map. For the studied datasets, altitude-dependent relations for the global dataset were found between the difference profiles and studied variables. From the lowest altitude studied (18 km) ascending, the most influencing factors were found to be longitude, followed by solar zenith angle and latitude, sensor age and again solar zenith angle together with the day of the year at the highest altitudes studied here (up to 45 km). Clustering into three classes showed that there are also some local dependencies, with for instance one cluster having a much stronger correlation with the sensor age (days since launch) between 36 and 42 km. It was shown that the proposed approach provides a powerful tool for the exploring of differences between datasets without being limited to a-priori defined data subsets.

Magnetotelluric static shift: Estimation and removal using the cokriging method

Geophysics ◽  
2007 ◽  
Vol 72 (1) ◽  
pp. F25-F34 ◽  
Author(s):  
Benoit Tournerie ◽  
Michel Chouteau ◽  
Denis Marcotte
Keyword(s):  
Apparent Resistivity ◽  
A Priori ◽  
Shift Factor ◽  
Static Shift ◽  
Geostatistical Model ◽  
Data Set ◽  
Resistivity Sounding ◽  
The Difference ◽  
Cross Variogram

We present and test a new method to correct for the static shift affecting magnetotelluric (MT) apparent resistivity sounding curves. We use geostatistical analysis of apparent resistivity and phase data for selected periods. For each period, we first estimate and model the experimental variograms and cross variogram between phase and apparent resistivity. We then use the geostatistical model to estimate, by cokriging, the corrected apparent resistivities using the measured phases and apparent resistivities. The static shift factor is obtained as the difference between the logarithm of the corrected and measured apparent resistivities. We retain as final static shift estimates the ones for the period displaying the best correlation with the estimates at all periods. We present a 3D synthetic case study showing that the static shift is retrieved quite precisely when the static shift factors are uniformly distributed around zero. If the static shift distribution has a nonzero mean, we obtained best results when an apparent resistivity data subset can be identified a priori as unaffected by static shift and cokriging is done using only this subset. The method has been successfully tested on the synthetic COPROD-2S2 2D MT data set and on a 3D-survey data set from Las Cañadas Caldera (Tenerife, Canary Islands) severely affected by static shift.

Validation of Sentinel-5P TROPOMI tropospheric NO2 with airborne imaging, ground-based stationary, and mobile DOAS measurements from the S5P-VAL-DE-Ruhr campaign

2021 ◽  
Author(s):  
Kezia Lange ◽  
Andreas C. Meier ◽  
Michel Van Roozendael ◽  
Thomas Wagner ◽  
Thomas Ruhtz ◽  
...  
Keyword(s):  
A Priori ◽  
Data Sets ◽  
Vertical Column ◽  
Data Set ◽  
Ruhr Area ◽  
Spatial And Temporal Heterogeneity ◽  
Western Germany ◽  
Airborne Imaging ◽  
Urban Character ◽  
One Year

<p>Airborne imaging DOAS and ground-based stationary and mobile DOAS measurements were conducted during the ESA funded S5P-VAL-DE-Ruhr campaign in September 2020 in the Ruhr area. The Ruhr area is located in Western Germany and is a pollution hotspot in Europe with urban character as well as large industrial emitters. The measurements are used to validate data from the Sentinel-5P TROPOspheric Monitoring Instrument (TROPOMI) with focus on the NO<sub>2</sub> tropospheric vertical column product.</p><p>Seven flights were performed with the airborne imaging DOAS instrument, AirMAP, providing continuous maps of NO<sub>2</sub> in the layers below the aircraft. These flights cover many S5P ground pixels within an area of about 40 km side length and were accompanied by ground-based stationary measurements and three mobile car DOAS instruments. Stationary measurements were conducted by two Pandora, two zenith-sky and two MAX-DOAS instruments distributed over three target areas, partly as long-term measurements over a one-year period.</p><p>Airborne and ground-based measurements were compared to evaluate the representativeness of the measurements in time and space. With a resolution of about 100 x 30 m<sup>2</sup>, the AirMAP data creates a link between the ground-based and the TROPOMI measurements with a resolution of 3.5 x 5.5 km<sup>2</sup> and is therefore well suited to validate TROPOMI's tropospheric NO<sub>2</sub> vertical column.</p><p>The measurements on the seven flight days show strong variability depending on the different target areas, the weekday and meteorological conditions. We found an overall low bias of the TROPOMI operational NO<sub>2</sub> data for all three target areas but with varying magnitude for different days. The campaign data set is compared to custom TROPOMI NO<sub>2</sub> products, using different auxiliary data, such as albedo or a priori vertical profiles to evaluate the influence on the TROPOMI data product. Analyzing and comparing the different data sets provides more insight into the high spatial and temporal heterogeneity in NO<sub>2</sub> and its impact on satellite observations and their validation.</p>

Marlim R3D: A realistic model for controlled-source electromagnetic simulations — Phase 2: The controlled-source electromagnetic data set

Geophysics ◽  
2019 ◽  
Vol 84 (5) ◽  
pp. E293-E299
Author(s):  
Jorlivan L. Correa ◽  
Paulo T. L. Menezes
Keyword(s):  
A Priori ◽  
Synthetic Data ◽  
Realistic Model ◽  
Earth Model ◽  
Data Sets ◽  
Data Set ◽  
Geoelectric Model ◽  
Controlled Source ◽  
The North ◽  
Electromagnetic Simulations

Synthetic data provided by geoelectric earth models are a powerful tool to evaluate a priori a controlled-source electromagnetic (CSEM) workflow effectiveness. Marlim R3D (MR3D) is an open-source complex and realistic geoelectric model for CSEM simulations of the postsalt turbiditic reservoirs at the Brazilian offshore margin. We have developed a 3D CSEM finite-difference time-domain forward study to generate the full-azimuth CSEM data set for the MR3D earth model. To that end, we fabricated a full-azimuth survey with 45 towlines striking the north–south and east–west directions over a total of 500 receivers evenly spaced at 1 km intervals along the rugged seafloor of the MR3D model. To correctly represent the thin, disconnected, and complex geometries of the studied reservoirs, we have built a finely discretized mesh of [Formula: see text] cells leading to a large mesh with a total of approximately 90 million cells. We computed the six electromagnetic field components (Ex, Ey, Ez, Hx, Hy, and Hz) at six frequencies in the range of 0.125–1.25 Hz. In our efforts to mimic noise in real CSEM data, we summed to the data a multiplicative noise with a 1% standard deviation. Both CSEM data sets (noise free and noise added), with inline and broadside geometries, are distributed for research or commercial use, under the Creative Common License, at the Zenodo platform.

A Ccomparison of sedigraph and pipette methods for soil particle-size analysis

Soil Research ◽  
1993 ◽  
Vol 31 (4) ◽  
pp. 407 ◽  
Author(s):  
GD Buchan ◽  
KS Grewal ◽  
JJ Claydon ◽  
RJ Mcpherson
Keyword(s):  
Particle Size ◽  
New Zealand ◽  
Particle Size Analysis ◽  
Size Analysis ◽  
Data Sets ◽  
Regression Equations ◽  
Total Iron Content ◽  
Data Set ◽  
X Ray ◽  
The Difference

The X-ray attenuation (Sedigraph) method for particle-size analysis is known to consistently estimate a finer size distribution than the pipette method. The objectives of this study were to compare the two methods, and to explore the reasons for their divergence. The methods are compared using two data sets from measurements made independently in two New Zealand laboratories, on two different sets of New Zealand soils, covering a range of textures and parent materials. The Sedigraph method gave systematically greater mass percentages at the four measurement diameters (20, 10, 5 and 2 �m). For one data set, the difference between clay (<2 �m) percentages from the two methods is shown to be positively correlated (R2 = 0.625) with total iron content of the sample, for all but one of the soils. This supports a novel hypothesis that the typically greater concentration of Fe (a strong X-ray absorber) in smaller size fractions is the major factor causing the difference. Regression equations are presented for converting the Sedigraph data to their pipette equivalents.

scholarly journals Two decades of satellite observations of AOD over mainland China using ATSR-2, AATSR and MODIS/Terra: data set evaluation and large-scale patterns

2018 ◽  
Vol 18 (3) ◽  
pp. 1573-1592 ◽  
Author(s):  
Gerrit de Leeuw ◽  
Larisa Sogacheva ◽  
Edith Rodriguez ◽  
Konstantinos Kourtidis ◽  
Aristeidis K. Georgoulias ◽  
...  
Keyword(s):  
Time Series ◽  
European Space Agency ◽  
Mainland China ◽  
Satellite Observations ◽  
Data Sets ◽  
Data Set ◽  
Modis Aod ◽  
The Difference ◽  
Along Track ◽  
Aerosol Properties

Abstract. The retrieval of aerosol properties from satellite observations provides their spatial distribution over a wide area in cloud-free conditions. As such, they complement ground-based measurements by providing information over sparsely instrumented areas, albeit that significant differences may exist in both the type of information obtained and the temporal information from satellite and ground-based observations. In this paper, information from different types of satellite-based instruments is used to provide a 3-D climatology of aerosol properties over mainland China, i.e., vertical profiles of extinction coefficients from the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP), a lidar flying aboard the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO) satellite and the column-integrated extinction (aerosol optical depth – AOD) available from three radiometers: the European Space Agency (ESA)'s Along-Track Scanning Radiometer version 2 (ATSR-2), Advanced Along-Track Scanning Radiometer (AATSR) (together referred to as ATSR) and NASA's Moderate Resolution Imaging Spectroradiometer (MODIS) aboard the Terra satellite, together spanning the period 1995–2015. AOD data are retrieved from ATSR using the ATSR dual view (ADV) v2.31 algorithm, while for MODIS Collection 6 (C6) the AOD data set is used that was obtained from merging the AODs obtained from the dark target (DT) and deep blue (DB) algorithms, further referred to as the DTDB merged AOD product. These data sets are validated and differences are compared using Aerosol Robotic Network (AERONET) version 2 L2.0 AOD data as reference. The results show that, over China, ATSR slightly underestimates the AOD and MODIS slightly overestimates the AOD. Consequently, ATSR AOD is overall lower than that from MODIS, and the difference increases with increasing AOD. The comparison also shows that neither of the ATSR and MODIS AOD data sets is better than the other one everywhere. However, ATSR ADV has limitations over bright surfaces which the MODIS DB was designed for. To allow for comparison of MODIS C6 results with previous analyses where MODIS Collection 5.1 (C5.1) data were used, also the difference between the C6 and C5.1 merged DTDB data sets from MODIS/Terra over China is briefly discussed. The AOD data sets show strong seasonal differences and the seasonal features vary with latitude and longitude across China. Two-decadal AOD time series, averaged over all of mainland China, are presented and briefly discussed. Using the 17 years of ATSR data as the basis and MODIS/Terra to follow the temporal evolution in recent years when the environmental satellite Envisat was lost requires a comparison of the data sets for the overlapping period to show their complementarity. ATSR precedes the MODIS time series between 1995 and 2000 and shows a distinct increase in the AOD over this period. The two data series show similar variations during the overlapping period between 2000 and 2011, with minima and maxima in the same years. MODIS extends this time series beyond the end of the Envisat period in 2012, showing decreasing AOD.

scholarly journals Evaluative application of UKCP09‐based downscaled future weather years to simulate overheating risk in typical English homes

2013 ◽  
Vol 31 (4) ◽  
pp. 231-252 ◽  
Author(s):  
Rajat Gupta ◽  
Matthew Gregg ◽  
Hu Du ◽  
Katie Williams
Keyword(s):  
Climate Change ◽  
Simulation Modelling ◽  
Simulation Software ◽  
Building Simulation ◽  
Future Research ◽  
Climate Projections ◽  
Data Sets ◽  
Data Set ◽  
Content Type ◽  
The Difference

PurposeTo critically compare three future weather year (FWY) downscaling approaches, based on the 2009 UK Climate Projections, used for climate change impact and adaptation analysis in building simulation software.Design/methodology/approachThe validity of these FWYs is assessed through dynamic building simulation modelling to project future overheating risk in typical English homes in 2050s and 2080s.FindingsThe modelling results show that the variation in overheating projections is far too significant to consider the tested FWY data sets equally suitable for the task.Research and practical implicationsIt is recommended that future research should consider harmonisation of the downscaling approaches so as to generate a unified data set of FWYs to be used for a given location and climate projection. If FWY are to be used in practice, live projects will need viable and reliable FWY on which to base their adaptation decisions. The difference between the data sets tested could potentially lead to different adaptation priorities specifically with regard to time series and adaptation phasing through the life of a building.Originality/valueThe paper investigates the different results derived from FWY application to building simulation. The outcome and implications are important considerations for research and practice involved in FWY data use in building simulation intended for climate change adaptation modelling.

scholarly journals SCIAMACHY WFM-DOAS XCO<sub>2</sub>: comparison with CarbonTracker XCO<sub>2</sub> focusing on aerosols and thin clouds

2012 ◽  
Vol 5 (2) ◽  
pp. 2887-2931 ◽  
Author(s):  
J. Heymann ◽  
O. Schneising ◽  
M. Reuter ◽  
M. Buchwitz ◽  
V. V. Rozanov ◽  
...  
Keyword(s):  
Southern Hemisphere ◽  
Temporal Correlation ◽  
Anthropogenic Activity ◽  
Data Sets ◽  
Spatial Correlations ◽  
Data Set ◽  
Cloud Data ◽  
Temporal Correlations ◽  
Retrieval Errors ◽  
The Difference

Abstract. Carbon dioxide (CO2) is the most important greenhouse gas whose atmospheric loading has been significantly increased by anthropogenic activity leading to global warming. Accurate measurements and models are needed in order to reliably predict our future climate. This, however, has challenging requirements. Errors in measurements and models need to be identified and minimised. In this context, we present a comparison between satellite-derived column-averaged dry air mole fractions of CO2, denoted XCO2, retrieved from SCIAMACHY/ENVISAT using the WFM-DOAS algorithm, and output from NOAA's global CO2 modelling and assimilation system CarbonTracker. We investigate to what extent differences between these two data sets are influenced by systematic retrieval errors due to aerosols and unaccounted clouds. We analyse seven years of SCIAMACHY WFM-DOAS version 2.1 retrievals (WFMDv2.1) using the latest version of CarbonTracker (version 2010). We investigate to what extent the difference between SCIAMACHY and CarbonTracker XCO2 are temporally and spatially correlated with global aerosol and cloud data sets. For this purpose, we use a global aerosol data set generated within the European GEMS project, which is based on assimilated MODIS satellite data. For clouds, we use a data set derived from CALIOP/CALIPSO. We find significant correlations of the SCIAMACHY minus CarbonTracker XCO2 difference with thin clouds over the Southern Hemisphere. The maximum temporal correlation we find for Darwin, Australia (r2 = 54%). Large temporal correlations with thin clouds are also observed over other regions of the Southern Hemisphere (e.g. 43% for South America and 31% for South Africa). Over the Northern Hemisphere the temporal correlations are typically much lower. An exception is India, where large temporal correlations with clouds and aerosols have also been found. For all other regions the temporal correlations with aerosol are typically low. For the spatial correlations the picture is less clear. They are typically low for both aerosols and clouds, but dependent on region and season, they may exceed 30% (the maximum value of 46% has been found for Darwin during September to November). Overall we find that the presence of thin clouds can potentially explain a significant fraction of the difference between SCIAMACHY WFMDv2.1 XCO2 and CarbonTracker over the Southern Hemisphere. Aerosols appear to be less of a problem. Our study indicates that the quality of the satellite derived XCO2 will significantly benefit from a reduction of scattering related retrieval errors at least for the Southern Hemisphere.

scholarly journals Lidar temperature series in the middle atmosphere as a reference data set. Part A: Improved retrievals and a 20 year cross-validation of two co-located French lidars

2018 ◽  
Author(s):  
Robin Wing ◽  
Alain Hauchecorne ◽  
Philippe Keckhut ◽  
Sophie Godin-Beekmann ◽  
Sergey Khaykin ◽  
...  
Keyword(s):  
Cross Validation ◽  
Middle Atmosphere ◽  
A Priori ◽  
Treatment Algorithm ◽  
Absolute Temperature ◽  
Atmospheric Composition ◽  
Data Set ◽  
Lidar Measurements ◽  
Ground Based Lidar

Abstract. The objective of this paper and its companion (Wing et al., 2018b) is to show that ground based lidar temperatures are a stable, accurate and precise dataset for use in validating satellite temperatures at high vertical resolution. Long-term lidar observations of the middle atmosphere have been conducted at the Observatoire de Haute-Provence (OHP), located in southern France (43.93° N, 5.71° E), since 1978. Making use of 20 years of high-quality co-located lidar measurements we have shown that lidar temperatures calculated using the Rayleigh technique at 532 nm are statistically identical to lidar temperatures calculated from the non-absorbing 355 nm channel of a Differential Absorption Lidar (DIAL) system. This result is of interest to members of the Network for the Detection of Atmospheric Composition Change (NDACC) ozone lidar community seeking to produce validated temperature products. Additionally, we have addressed previously published concerns of lidar-satellite relative warm bias in comparisons of Upper Mesospheric and Lower Thermospheric (UMLT) temperature profiles. We detail a data treatment algorithm which minimizes known errors due to data selection procedures, a priori choices, and initialization parameters inherent in the lidar retrieval. Our algorithm results in a median cooling of the lidar calculated absolute temperature profile by 20 K at 90 km altitude with respect to the standard OHP NDACC lidar temperature algorithm. The confidence engendered by the long-term cross-validation of two independent lidars and the improved lidar temperature dataset is exploited in (Wing et al., 2018b) for use in multi-year satellite validations.

scholarly journals The SPARC water vapour assessment II: Comparison of stratospheric and lower mesospheric water vapour time series observed from satellites

2018 ◽  
Author(s):  
Farahnaz Khosrawi ◽  
Stefan Lossow ◽  
Gabriele P. Stiller ◽  
Karen H. Rosenlof ◽  
Joachim Urban ◽  
...  
Keyword(s):  
Time Series ◽  
Water Vapour ◽  
Data Sets ◽  
Data Set ◽  
The Future ◽  
Modelling Studies ◽  
The Difference ◽  
The Tropics ◽  
The Antarctic ◽  
Satellite Instruments

Abstract. Time series of stratospheric and lower mesospheric water vapour using 33 data sets from 15 different satellite instruments were compared in the framework of the second SPARC (Stratosphere-troposphere Processes And their Role in Climate) water vapour assessment (WAVAS-II). This comparison aimed to provide a comprehensive overview of the typical uncertainties in the observational database that can be considered in the future in observational and modelling studies addressing e.g stratospheric water vapour trends. The time series comparisons are presented for the three latitude bands, the Antarctic (80°–70° S), the tropics (15° S–15° N) and the northern hemisphere mid-latitudes (50° N–60° N) at four different altitudes (0.1, 3, 10 and 80 hPa) covering the stratosphere and lower mesosphere. The combined temporal coverage of observations from the 15 satellite instruments allowed considering the time period 1986–2014. In addition to the qualitative comparison of the time series, the agreement of the data sets is assessed quantitatively in the form of the spread (i.e. the difference between the maximum and minimum volume mixing ratio among the data sets), the (Pearson) correlation coefficient and the drift (i.e. linear changes of the difference between time series over time). Generally, good agreement between the time series was found in the middle stratosphere while larger differences were found in the lower mesosphere and near the tropopause. Concerning the latitude bands, the largest differences were found in the Antarctic while the best agreement was found for the tropics. From our assessment we find that all data sets can be considered in the future in observational and modelling studies addressing e.g. stratospheric and lower mesospheric water vapour variability and trends when data set specific characteristics (e.g. a drift) and restrictions (e.g. temporal and spatial coverage) are taken into account.

Sign in / Sign up

Export Citation Format

Share Document