Image Inpainting for Missing Values in Observational Climate Datasets Using Partial Convolutions in a cuDNN

Author(s):  
Christopher Kadow ◽  
David Hall ◽  
Uwe Ulbrich

<p>Nowadays climate change research relies on climate information of the past. Historic climate records of temperature observations form global gridded datasets like HadCRUT4, which is investigated e.g. in the IPCC reports. However, record combining data-sets are sparse in the past. Even today they contain missing values. Here we show that machine learning technology can be applied to refill these missing climate values in observational datasets. We found that the technology of image inpainting using partial convolutions in a CUDA accelerated deep neural network can be trained by large Earth system model experiments from NOAA reanalysis (20CR) and the Coupled Model Intercomparison Project phase 5 (CMIP5). The derived deep neural networks are capable to independently refill added missing values of these experiments. The analysis shows a very high degree of reconstruction even in the cross-reconstruction of the trained networks on the other dataset. The network reconstruction reaches a better evaluation than other typical methods in climate science. In the end we will show the new reconstructed observational dataset HadCRUT4 and discuss further investigations.</p>

2014 ◽  
Vol 70 (a1) ◽  
pp. C185-C185
Author(s):  
Stef Smeets ◽  
Lynne McCusker ◽  
Christian Baerlocher ◽  
Dan Xie ◽  
Stacey Zones ◽  
...  

High-resolution synchrotron X-ray powder diffraction (SXPD) data alone are sometimes not enough to solve the structure of a complex polycrystalline material. Such was the case for the high-silica zeolites SSZ-61 and SSZ-87, where combining data from different sources, in particular XPD and electron microscopy, was vital to success. For SSZ-61, the SXPD data feature broad peaks and a resolution of ca. 1.2 Å. Although the pattern could be indexed, structure determination failed both with the charge flipping routine in SUPERFLIP [1] and with the zeolite-specific program FOCUS [2]. The unit cell parameters and HRTEM images indicated a relationship with ZSM-12 (MTW) and SSZ-59 (SFN), so several models derived from these two frameworks were built. Eventually, after considering Si-29 MAS NMR data and the size of the organic structure directing agent (SDA), a framework model that fits all the data emerged. To complete the structure, the SDA was included as a rigid-body, and its location and orientation optimized using simulated annealing. Subsequent Rietveld refinement confirmed the structure. In contrast to SSZ-61, the SXPD pattern for SSZ-87 was quite good, and it could be indexed with a C-centered cell. However, structure solution failed, probably because of the very high degree of reflection overlap (93%). Therefore, rotation electron diffraction (RED) data [3] were collected, but they proved to be of low resolution and poor quality. Only 2 of the 7 data sets could be indexed, and these had different unit cells. Neither fit the XPD pattern directly. The problem was traced to large errors in the RED cell parameters, and eventually one RED cell could be transformed to one similar to the SXPD cell. The RED data with this cell was only 15% complete up to a resolution of 1.22 Å. Even so, the structure could be solved using a recently developed version of FOCUS that works with ED data. The SDA was found as for SSZ-61, and the structure then confirmed by Rietveld refinement.


Life ◽  
2021 ◽  
Vol 11 (6) ◽  
pp. 583
Author(s):  
Giulia Furfaro ◽  
Paolo Mariottini

Integrative taxonomy is an evolving field of multidisciplinary studies often utilised to elucidate phylogenetic reconstructions that were poorly understood in the past. The systematics of many taxa have been resolved by combining data from different research approaches, i.e., molecular, ecological, behavioural, morphological and chemical. Regarding molecular analysis, there is currently a search for new genetic markers that could be diagnostic at different taxonomic levels and that can be added to the canonical ones. In marine Heterobranchia, the most widely used mitochondrial markers, COI and 16S, are usually analysed by comparing the primary sequence. The 16S rRNA molecule can be folded into a 2D secondary structure that has been poorly exploited in the past study of heterobranchs, despite 2D molecular analyses being sources of possible diagnostic characters. Comparison of the results from the phylogenetic analyses of a concatenated (the nuclear H3 and the mitochondrial COI and 16S markers) dataset (including 30 species belonging to eight accepted genera) and from the 2D folding structure analyses of the 16S rRNA from the type species of the genera investigated demonstrated the diagnostic power of this RNA molecule to reveal the systematics of four genera belonging to the family Myrrhinidae (Gastropoda, Heterobranchia). The “molecular morphological” approach to the 16S rRNA revealed to be a powerful tool to delimit at both species and genus taxonomic levels and to be a useful way of recovering information that is usually lost in phylogenetic analyses. While the validity of the genera Godiva, Hermissenda and Phyllodesmium are confirmed, a new genus is necessary and introduced for Dondice banyulensis, Nemesis gen. nov. and the monospecific genus Nanuca is here synonymised with Dondice, with Nanuca sebastiani transferred into Dondice as Dondice sebastiani comb. nov.


Symmetry ◽  
2021 ◽  
Vol 13 (7) ◽  
pp. 1116
Author(s):  
Zeba Mahmood ◽  
Vacius Jusas

This paper introduces a blockchain-based federated learning (FL) framework with incentives for participating nodes to enhance the accuracy of classification problems. Machine learning technology has been rapidly developed and changed from a global perspective for the past few years. The FL framework is based on the Ethereum blockchain and creates an autonomous ecosystem, where nodes compete to improve the accuracy of classification problems. With privacy being one of the biggest concerns, FL makes use of the blockchain-based approach to ensure privacy and security. Another important technology that underlies the FL framework is zero-knowledge proofs (ZKPs), which ensure that data uploaded to the network are accurate and private. Basically, ZKPs allow nodes to compete fairly by only submitting accurate models to the parameter server and get rewarded for that. We have conducted an analysis and found that ZKPs can help improve the accuracy of models submitted to the parameter server and facilitate the honest participation of all nodes in FL.


2003 ◽  
Vol 60 (2_suppl) ◽  
pp. 3S-75S ◽  
Author(s):  
Jack Hadley

Health services research conducted over the past 25 years makes a compelling case that having health insurance or using more medical care would improve the health of the uninsured. The literature's broad range of conditions, populations, and methods makes it difficult to derive a precise quantitative estimate of the effect of having health insurance on the uninsured's health. Some mortality studies imply that a 4% to 5% reduction in the uninsured's mortality is a lower bound; other studies suggest that the reductions could be as high as 20% to 25%. Although all of the studies reviewed suffer from methodological flaws of varying degrees, there is substantial qualitative consistency across studies of different medical conditions conducted at different times and using different data sets and statistical methods. Corroborating process studies find that the uninsured receive fewer preventive and diagnostic services, tend to be more severely ill when diagnosed, and receive less therapeutic care. Other literature suggests that improving health status from fair or poor to very good or excellent would increase both work effort and annual earnings by approximately 15% to 20%.


Agriculture ◽  
2021 ◽  
Vol 11 (7) ◽  
pp. 614
Author(s):  
Ayan Orazov ◽  
Liudmila Nadtochii ◽  
Kazybay Bozymov ◽  
Mariam Muradova ◽  
Araigul Zhumayeva

This paper examines the problem of food security in the Republic of Kazakhstan over the past 10 years. Based on statistical data, an assessment was made of the prevalence of malnutrition among the population of the country, including children under 5 years of age. There has been a trend towards for an improvement in the nutrition of the population for a few indicators; however, further optimization of food security indicators is required to achieve the goals of sustainable development (SDGs) of the FAO WHO Agenda for the period up to 2050 in Kazakhstan and in its individual regions. The paper reflects data on demographic changes over the past 10 years and its self-sufficiency in basic foods for 2019. A high degree of self-sufficiency in meat products (117.6%) is revealed in the population of the Republic of Kazakhstan. However, self-sufficiency in dairy products is at an extremely low level (0.1%). Camel breeding has been successfully developing in the country over the past 10 years. However, the number of camels in the country is still at a low level. Camel milk can be considered as a great source of macronutrients, its daily consumption partially facilitates the problem of Food Security in Kazakhstan.


2021 ◽  
pp. 205789112110192
Author(s):  
Peng Lin

Engaging in disaster relief and, more recently, post-disaster reconstruction in developing countries with critical geoeconomic and geopolitical interests has become an increasingly regular and institutionalized component of China’s evolving humanitarian diplomacy over the past decade. Drawn upon novel evidence from China’s growing disaster-related humanitarian assistance to Nepal and unprecedented engagement in Nepal’s long-term post-earthquake rebuild since 2015, this article explores the dynamics behind China’s transforming humanitarian diplomacy. The findings of this article suggest that: 1) geopolitical and geoeconomic interests, represented by the Belt-and-Road Initiative, serve as a critical driver for the development of China’s bilateral partnership with other countries in the disaster sector; 2) long-term cooperation with underdeveloped countries like Nepal provides China, both government and non-state actors (NSAs), with an effective channel to engage with the international humanitarian community and to internalize humanitarian norms; 3) although humanitarian missions remain contingent and instrumental in China’s international relations, they are laying the foundations for a specialized humanitarian policy area with more relevant normative assets, more professional actors, and more sophisticated institutions; 4) NSAs, represented by private foundations and civil NGOs, have played active roles in the state-dominant cooperation in disaster management. This article also suggests that intensified geopolitical confrontations, such as military clashes between India and China along their disputed borders over the past year, would lead to a high degree of politicization of humanitarian missions and partnerships counter-conducive to humanitarian goals.


2020 ◽  
Vol 94 (9) ◽  
Author(s):  
Lars E. Sjöberg

Abstract As the KTH method for geoid determination by combining Stokes integration of gravity data in a spherical cap around the computation point and a series of spherical harmonics suffers from a bias due to truncation of the data sets, this method is based on minimizing the global mean square error (MSE) of the estimator. However, if the harmonic series is increased to a sufficiently high degree, the truncation error can be considered as negligible, and the optimization based on the local variance of the geoid estimator makes fair sense. Such unbiased types of estimators, derived in this article, have the advantage to the MSE solutions not to rely on the imperfectly known gravity signal degree variances, but only the local error covariance matrices of the observables come to play. Obviously, the geoid solution defined by the local least variance is generally superior to the solution based on the global MSE. It is also shown, at least theoretically, that the unbiased geoid solutions based on the KTH method and remove–compute–restore technique with modification of Stokes formula are the same.


1961 ◽  
Vol 51 (4) ◽  
pp. 755-764 ◽  
Author(s):  
G. B. Whitehead ◽  
J. A. F. Baker

Early in 1959, observations on the farm Tayside, in the East London district of South Africa, suggested that populations of the ‘two-host’ red tick, Rhipicephalns evertsi Neum., were more difficult to control with toxaphene preparations than they had been in the past. Resistance to toxaphene was suspected, and both field and laboratory experiments were carried out to investigate this possibility. Field trials indicated an increase in tolerance by Tayside populations of the tick to toxaphene, γ BHC and dieldrin, but showed no increased tolerance to sodium arsenite or DDT. Similar results were obtained in laboratory experiments where Tayside adults were compared with those of other populations of the tick known to be sensitive to insecticides. Laboratory experiments with larvae indicated a high degree of resistance to toxaphene and γ BHC in the Tayside population, but no increased tolerance to sodium arsenite, Delnav, Sevin or DDT could be detected. This pattern of cross-resistance is similar to that occurring in resistant populations of Boophilus dccoloratus(Koch).


2018 ◽  
Vol 617 ◽  
pp. A108 ◽  
Author(s):  
T. Appourchaux ◽  
P. Boumier ◽  
J. W. Leibacher ◽  
T. Corbard

Context. The recent claims of g-mode detection have restarted the search for these potentially extremely important modes. These claims can be reassessed in view of the different data sets available from the SoHO instruments and ground-based instruments. Aims. We produce a new calibration of the GOLF data with a more consistent p-mode amplitude and a more consistent time shift correction compared to the time series used in the past. Methods. The calibration of 22 yr of GOLF data is done with a simpler approach that uses only the predictive radial velocity of the SoHO spacecraft as a reference. Using p modes, we measure and correct the time shift between ground- and space-based instruments and the GOLF instrument. Results. The p-mode velocity calibration is now consistent to within a few percent with other instruments. The remaining time shifts are within ±5 s for 99.8% of the time series.


Author(s):  
Anastasiia Ivanitska ◽  
Dmytro Ivanov ◽  
Ludmila Zubik

The analysis of the available methods and models of formation of recommendations for the potential buyer in network information systems for the purpose of development of effective modules of selection of advertising is executed. The effectiveness of the use of machine learning technologies for the analysis of user preferences based on the processing of data on purchases made by users with a similar profile is substantiated. A model of recommendation formation based on machine learning technology is proposed, its work on test data sets is tested and the adequacy of the RMSE model is assessed. Keywords: behavior prediction; advertising based on similarity; collaborative filtering; matrix factorization; big data; machine learning


Sign in / Sign up

Export Citation Format

Share Document