Toward a Multi-method Approach: Lossy Data Compression for Climate Simulation Data

Author(s):  
Allison H. Baker ◽  
Haiying Xu ◽  
Dorit M. Hammerling ◽  
Shaomeng Li ◽  
John P. Clyne
2016 ◽  
Author(s):  
Allison H. Baker ◽  
Dorit M. Hammerling ◽  
Sheri A. Mickleson ◽  
Haiying Xu ◽  
Martin B. Stolpe ◽  
...  

Abstract. High-resolution earth system model simulations generate enormous data volumes, and retaining the data from these simulations often strains institutional storage resources. Further, these exceedingly large storage requirements negatively impact science objectives by forcing reductions in data output frequency, simulation length, or ensemble size, for example. To lessen data volumes from the Community Earth System Model (CESM), we advocate the use of lossy data compression techniques. While lossy data compression does not exactly preserve the original data (as lossless compression does), lossy techniques have an advantage in terms of smaller storage requirements. To preserve the integrity of the scientific simulation data, the effects of lossy data compression on the original data should, at a minimum, not be statistically distinguishable from the natural variability of the climate system, and previous preliminary work with data from CESM has shown this goal to be attainable. However, to ultimately convince climate scientists that it is acceptable to use lossy data compression, we provide climate scientists with access to publicly available climate data that has undergone lossy data compression. In particular, we report on the results of a lossy data compression experiment with output from the CESM Large Ensemble (CESM-LE) Community Project, in which we challenge climate scientists to examine features of the data relevant to their interests, and attempt to identify which of the ensemble members have been compressed and reconstructed. We find that while detecting distinguishing features is certainly possible, the compression effects noticeable in these features are often unimportant or disappear in post-processing analyses. In addition, we perform several analyses that directly compare the original data to the reconstructed data to investigate the preservation, or lack thereof, of specific features critical to climate science. Overall, we conclude that applying lossy data compression to climate simulation data is both advantageous in terms of data reduction and generally acceptable in terms of effects on scientific results.


2016 ◽  
Vol 9 (12) ◽  
pp. 4381-4403 ◽  
Author(s):  
Allison H. Baker ◽  
Dorit M. Hammerling ◽  
Sheri A. Mickelson ◽  
Haiying Xu ◽  
Martin B. Stolpe ◽  
...  

Abstract. High-resolution Earth system model simulations generate enormous data volumes, and retaining the data from these simulations often strains institutional storage resources. Further, these exceedingly large storage requirements negatively impact science objectives, for example, by forcing reductions in data output frequency, simulation length, or ensemble size. To lessen data volumes from the Community Earth System Model (CESM), we advocate the use of lossy data compression techniques. While lossy data compression does not exactly preserve the original data (as lossless compression does), lossy techniques have an advantage in terms of smaller storage requirements. To preserve the integrity of the scientific simulation data, the effects of lossy data compression on the original data should, at a minimum, not be statistically distinguishable from the natural variability of the climate system, and previous preliminary work with data from CESM has shown this goal to be attainable. However, to ultimately convince climate scientists that it is acceptable to use lossy data compression, we provide climate scientists with access to publicly available climate data that have undergone lossy data compression. In particular, we report on the results of a lossy data compression experiment with output from the CESM Large Ensemble (CESM-LE) Community Project, in which we challenge climate scientists to examine features of the data relevant to their interests, and attempt to identify which of the ensemble members have been compressed and reconstructed. We find that while detecting distinguishing features is certainly possible, the compression effects noticeable in these features are often unimportant or disappear in post-processing analyses. In addition, we perform several analyses that directly compare the original data to the reconstructed data to investigate the preservation, or lack thereof, of specific features critical to climate science. Overall, we conclude that applying lossy data compression to climate simulation data is both advantageous in terms of data reduction and generally acceptable in terms of effects on scientific results.


2019 ◽  
Vol 20 (4) ◽  
pp. 125-146
Author(s):  
Jae-Hyouk Jahng

2019 ◽  
Author(s):  
Paul S. Martin ◽  
◽  
Blair R. Tormey ◽  
John M. Sullivan ◽  
Craig A Schultz

Author(s):  
William V. Pelfrey

AbstractDisasters can move quickly. Effective communication is a critical resource that can significantly enhance public safety. A mass notification system (MNS) uses text messaging to inform constituents of crisis, provide recommendations, connect to resources, and has the advantage of speed. Limited research has been conducted on the variables that influence the effectiveness, utilization, and perceptions of MNS. The extant study employs a multi-method approach to advance the scholarly knowledge on MNS. All emergency managers in a state were surveyed on issues of MNS enrollment, utilization, and brand. A subgroup of emergency managers were then interviewed to provide depth to the survey findings. Key findings indicate wide variability in MNS usage, little relationship between population size and enrollment, and a high perceived importance of MNS as a communication modality. Policy implications and recommendations are offered.


2021 ◽  
pp. 026858092199451
Author(s):  
Adrian Scribano

The social sciences in Latin America have always had a special connection with the study and analysis of the place of emotions in the social structuration processes. The aim of this article is to offer a synthetic exposition of some inquiries about emotions and the politics of sensibilities in Latin America, emphasizing those that are being felt in the context of the COVID-19 pandemic. To achieve this objective, first we offer a synthesis of the theoretical and methodological points that will guide the interpretation; then we draw on pre-existing inquiries and surveys which allow us to capture the state of sensibilities before and during the pandemic in the region; and finally some conclusions are presented. The work is based on a multi-method approach, where qualitative and quantitative secondary and primary data are articulated in tandem.


2021 ◽  
pp. 030913252098512
Author(s):  
Adam Bledsoe

This article argues that work on geographies of Blackness and Black Geographies emphasizes different aspects of Black experiences and relies on different methodologies in making these emphases. I focus on the work of six prominent geographers who engage with questions of Blackness and examine the different data sources they draw on. I show that they all employ a multi-method, interdisciplinary approach in their scholarship and that all of them, regardless of emphasis or method, foreground the experiences of black populations. I argue that this collective multi-method approach pushes the conceptual boundaries of the wider discipline of Geography.


Author(s):  
Renata de Oliveira Mota ◽  
Moacir Godinho Filho ◽  
Lauro Osiro ◽  
Gilberto Miller Devós Ganga ◽  
Glauco Henrique de Sousa Mendes

Sign in / Sign up

Export Citation Format

Share Document