Building Predictive Models for Noisy and Heterogeneous Data: An Application in Global Monitoring of Inland Water Dynamics

Author(s):  
Anuj Karpatne ◽  
Vipin Kumar
2020 ◽  
Vol 117 (25) ◽  
pp. 13876-13878 ◽  
Author(s):  
Jingying Zhu ◽  
Chunqiao Song ◽  
Jida Wang ◽  
Linghong Ke

Author(s):  
Doina Caragea ◽  
Vasant Honavar

Recent advances in sensors, digital storage, computing and communications technologies have led to a proliferation of autonomously operated, geographically distributed data repositories in virtually every area of human endeavor, including e-business and e-commerce, e-science, e-government, security informatics, etc. Effective use of such data in practice (e.g., building useful predictive models of consumer behavior, discovery of factors that contribute to large climatic changes, analysis of demographic factors that contribute to global poverty, analysis of social networks, or even finding out what makes a book a bestseller) requires accessing and analyzing data from multiple heterogeneous sources. The Semantic Web enterprise (Berners-Lee et al., 2001) is aimed at making the contents of the Web machine interpretable, so that heterogeneous data sources can be used together. Thus, data and resources on the Web are annotated and linked by associating meta data that make explicit the ontological commitments of the data source providers or, in some cases, the shared ontological commitments of a small community of users. Given the autonomous nature of the data sources on the Web and the diverse purposes for which the data are gathered, in the absence of a universal ontology it is inevitable that there is no unique global interpretation of the data, that serves the needs of all users under all scenarios. Many groups have attempted to develop, with varying degrees of success, tools for flexible integration and querying of data from semantically disparate sources (Levy, 2000; Noy, 2004; Doan, & Halevy, 2005), as well as techniques for discovering semantic correspondences between ontologies to assist in this process (Kalfoglou, & Schorlemmer, 2005; Noy and Stuckenschmidt, 2005). These and related advances in Semantic Web technologies present unprecedented opportunities for exploiting multiple related data sources, each annotated with its own meta data, in discovering useful knowledge in many application domains. While there has been significant work on applying machine learning to ontology construction, information extraction from text, and discovery of mappings between ontologies (Kushmerick, et al., 2005), there has been relatively little work on machine learning approaches to knowledge acquisition from data sources annotated with meta data that expose the structure (schema) and semantics (in reference to a particular ontology). However, there is a large body of literature on distributed learning (see (Kargupta, & Chan, 1999) for a survey). Furthermore, recent work (Zhang et al., 2005; Hotho et al., 2003) has shown that in addition to data, the use of meta data in the form of ontologies (class hierarchies, attribute value hierarchies) can improve the quality (accuracy, interpretability) of the learned predictive models. The purpose of this chapter is to precisely define the problem of knowledge acquisition from semantically heterogeneous data and summarize recent advances that have led to a solution to this problem (Caragea et al., 2005).


2020 ◽  
Vol 12 (23) ◽  
pp. 3896
Author(s):  
Ya-Lun S. Tsai ◽  
Igor Klein ◽  
Andreas Dietz ◽  
Natascha Oppelt

The warming climate is threatening to alter inland water resources on a global scale. Within all waterbody types, lake and river systems are vital not only for natural ecosystems but, also, for human society. Snowmelt phenology is also altered by global warming, and snowmelt is the primary water supply source for many river and lake systems around the globe. Hence, (1) monitoring snowmelt conditions, (2) tracking the dynamics of snowmelt-influenced river and lake systems, and (3) quantifying the causal effect of snowmelt conditions on these waterbodies are critical to understand the cryo-hydrosphere interactions under climate change. Previous studies utilized in-situ or multispectral sensors to track either the surface areas or water levels of waterbodies, which are constrained to small-scale regions and limited by cloud cover, respectively. On the contrary, in the present study, we employed the latest Sentinel-1 synthetic aperture radar (SAR) and Sentinel-3 altimetry data to grant a high-resolution, cloud-free, and illumination-independent comprehensive inland water dynamics monitoring strategy. Moreover, in contrast to previous studies utilizing in-house algorithms, we employed freely available cloud-based services to ensure a broad applicability with high efficiency. Based on altimetry and SAR data, the water level and the water-covered extent (WCE) (surface area of lakes and the flooded area of rivers) can be successfully measured. Furthermore, by fusing the water level and surface area information, for Lake Urmia, we can estimate the hypsometry and derive the water volume change. Additionally, for the Brahmaputra River, the variations of both the water level and the flooded area can be tracked. Last, but not least, together with the wet snow cover extent (WSCE) mapped with SAR imagery, we can analyze the influence of snowmelt conditions on water resource variations. The distributed lag model (DLM) initially developed in the econometrics discipline was employed, and the lagged causal effect of snowmelt conditions on inland water resources was eventually assessed.


2020 ◽  
Vol 243 ◽  
pp. 111792 ◽  
Author(s):  
Amy H. Pickens ◽  
Matthew C. Hansen ◽  
Matthew Hancher ◽  
Stephen V. Stehman ◽  
Alexandra Tyukavina ◽  
...  

Author(s):  
Anuj Karpatne ◽  
Ankush Khandelwal ◽  
Xi Chen ◽  
Varun Mithal ◽  
James Faghmous ◽  
...  

Author(s):  
Valeriy G. Yakubenko ◽  
Anna L. Chultsova

Identification of water masses in areas with complex water dynamics is a complex task, which is usually solved by the method of expert assessments. In this paper, it is proposed to use a formal procedure based on the application of the method of optimal multiparametric analysis (OMP analysis). The data of field measurements obtained in the 68th cruise of the R/V “Academician Mstislav Keldysh” in the summer of 2017 in the Barents Sea on the distribution of temperature, salinity, oxygen, silicates, nitrogen, and phosphorus concentration are used as a data for research. A comparison of the results with data on the distribution of water masses in literature based on expert assessments (Oziel et al., 2017), allows us to conclude about their close structural similarity. Some differences are related to spatial and temporal shifts of measurements. This indicates the feasibility of using the OMP analysis technique in oceanological studies to obtain quantitative data on the spatial distribution of different water masses.


Sign in / Sign up

Export Citation Format

Share Document