Data gaps and opportunities

Land surface temperature (LST) is an important environmental parameter in climate change, urban heat islands, drought, public health, and other fields. Thermal infrared (TIR) remote sensing is the main method used to obtain LST information over large spatial scales. However, cloud cover results in many data gaps in remotely sensed LST datasets, greatly limiting their practical applications. Many studies have sought to fill these data gaps and reconstruct cloud-free LST datasets over the last few decades. This paper reviews the progress of LST reconstruction research. A bibliometric analysis is conducted to provide a brief overview of the papers published in this field. The existing reconstruction algorithms can be grouped into five categories: spatial gap-filling methods, temporal gap-filling methods, spatiotemporal gap-filling methods, multi-source fusion-based gap-filling methods, and surface energy balance-based gap-filling methods. The principles, advantages, and limitations of these methods are described and discussed. The applications of these methods are also outlined. In addition, the validation of filled LST values’ cloudy pixels is an important concern in LST reconstruction. The different validation methods applied for reconstructed LST datasets are also reviewed herein. Finally, prospects for future developments in LST reconstruction are provided.

Download Full-text

Conditioning and PPP processing of smartphone GNSS measurements in realistic environments

Satellite Navigation ◽

10.1186/s43020-021-00042-2 ◽

2021 ◽

Vol 2 (1) ◽

Author(s):

Ganga Shinghal ◽

Sunil Bisnath

Keyword(s):

Single Point ◽

A Priori ◽

Density Ratio ◽

Satellite System ◽

Quality Parameters ◽

Urban Environments ◽

Dual Frequency ◽

Missing Measurements ◽

Data Gaps ◽

Point Positioning

AbstractSmartphones typically compute position using duty-cycled Global Navigation Satellite System (GNSS) L1 code measurements and Single Point Positioning (SPP) processing with the aid of cellular and other measurements. This internal positioning solution has an accuracy of several tens to hundreds of meters in realistic environments (handheld, vehicle dashboard, suburban, urban forested, etc.). With the advent of multi-constellation, dual-frequency GNSS chips in smartphones, along with the ability to extract raw code and carrier-phase measurements, it is possible to use Precise Point Positioning (PPP) to improve positioning without any additional equipment. This research analyses GNSS measurement quality parameters from a Xiaomi MI 8 dual-frequency smartphone in varied, realistic environments. In such environments, the system suffers from frequent phase loss-of-lock leading to data gaps. The smartphone measurements have low and irregular carrier-to-noise (C/N0) density ratio and high multipath, which leads to poor or no positioning solution. These problems are addressed by implementing a prediction technique for data gaps and a C/N0-based stochastic model for assigning realistic a priori weights to the observables in the PPP processing engine. Using these conditioning techniques, there is a 64% decrease in the horizontal positioning Root Mean Square (RMS) error and 100% positioning solution availability in sub-urban environments tested. The horizontal and 3D RMS were 20 cm and 30 cm respectively in a static open-sky environment and the horizontal RMS for the realistic kinematic scenario was 7 m with the phone on the dashboard of the car, using the SwiftNav Piksi Real-Time Kinematic (RTK) solution as reference. The PPP solution, computed using the YorkU PPP engine, also had a 5–10% percentage point more availability than the RTK solution, computed using RTKLIB software, since missing measurements in the logged file cause epoch rejection and a non-continuous solution, a problem which is solved by prediction for the PPP solution. The internal unaided positioning solution of the phone obtained from the logged NMEA (The National Marine Electronics Association) file was computed using point positioning with the aid of measurements from internal sensors. The PPP solution was 80% more accurate than the internal solution which had periodic drifts due to non-continuous computation of solution.

Download Full-text

Mapping the United Nations Fundamental Principles of Official Statistics against new and big data sources

Statistical Journal of the IAOS ◽

10.3233/sji-210789 ◽

2021 ◽

Vol 37 (1) ◽

pp. 161-169

Author(s):

Dominik Rozkrut ◽

Olga Świerkot-Strużewska ◽

Gemma Van Halderen

Keyword(s):

Big Data ◽

Public Information ◽

Fundamental Principle ◽

Data Sources ◽

Official Statistics ◽

Development Agenda ◽

Data Gaps ◽

Data Source ◽

Exciting Time ◽

Statistical Systems

Never has there been a more exciting time to be an official statistician. The data revolution is responding to the demands of the CoVID-19 pandemic and a complex sustainable development agenda to improve how data is produced and used, to close data gaps to prevent discrimination, to build capacity and data literacy, to modernize data collection systems and to liberate data to promote transparency and accountability. But can all data be liberated in the production and communication of official statistics? This paper explores the UN Fundamental Principles of Official Statistics in the context of eight new and big data sources. The paper concludes each data source can be used for the production of official statistics in adherence with the Fundamental Principles and argues these data sources should be used if National Statistical Systems are to adhere to the first Fundamental Principle of compiling and making available official statistics that honor citizen’s entitlement to public information.

Download Full-text

Evaluating Machine Learning and Geostatistical Methods for Spatial Gap-filling of Monthly ESA CCI Soil Moisture in China

Remote Sensing ◽

10.3390/rs13142848 ◽

2021 ◽

Vol 13 (14) ◽

pp. 2848

Author(s):

Hao Sun ◽

Qian Xu

Keyword(s):

Machine Learning ◽

Soil Moisture ◽

Water Resource Management ◽

Large Scale ◽

Gap Filling ◽

Spatial Continuity ◽

Study Results ◽

Data Gaps

Obtaining large-scale, long-term, and spatial continuous soil moisture (SM) data is crucial for climate change, hydrology, and water resource management, etc. ESA CCI SM is such a large-scale and long-term SM (longer than 40 years until now). However, there exist data gaps, especially for the area of China, due to the limitations in remote sensing of SM such as complex topography, human-induced radio frequency interference (RFI), and vegetation disturbances, etc. The data gaps make the CCI SM data cannot achieve spatial continuity, which entails the study of gap-filling methods. In order to develop suitable methods to fill the gaps of CCI SM in the whole area of China, we compared typical Machine Learning (ML) methods, including Random Forest method (RF), Feedforward Neural Network method (FNN), and Generalized Linear Model (GLM) with a geostatistical method, i.e., Ordinary Kriging (OK) in this study. More than 30 years of passive–active combined CCI SM from 1982 to 2018 and other biophysical variables such as Normalized Difference Vegetation Index (NDVI), precipitation, air temperature, Digital Elevation Model (DEM), soil type, and in situ SM from International Soil Moisture Network (ISMN) were utilized in this study. Results indicated that: 1) the data gap of CCI SM is frequent in China, which is found not only in cold seasons and areas but also in warm seasons and areas. The ratio of gap pixel numbers to the whole pixel numbers can be greater than 80%, and its average is around 40%. 2) ML methods can fill the gaps of CCI SM all up. Among the ML methods, RF had the best performance in fitting the relationship between CCI SM and biophysical variables. 3) Over simulated gap areas, RF had a comparable performance with OK, and they outperformed the FNN and GLM methods greatly. 4) Over in situ SM networks, RF achieved better performance than the OK method. 5) We also explored various strategies for gap-filling CCI SM. Results demonstrated that the strategy of constructing a monthly model with one RF for simulating monthly average SM and another RF for simulating monthly SM disturbance achieved the best performance. Such strategy combining with the ML method such as the RF is suggested in this study for filling the gaps of CCI SM in China.

Download Full-text