Freva - Free Evaluation System Framework - New Aspects and Features

Author(s):  
Christopher Kadow ◽  
Sebastian Illing ◽  
Oliver Kunst ◽  
Thomas Schartner ◽  
Jens Grieger ◽  
...  

<p>The Free Evaluation System Framework (Freva - freva.met.fu-berlin.de) is a software infrastructure for standardized data and tool solutions in Earth system science. Freva runs on high performance computers to handle customizable evaluation systems of research projects, institutes or universities. It combines different software technologies into one common hybrid infrastructure, including all features present in the shell and web environment. The database interface satisfies the international standards provided by the Earth System Grid Federation (ESGF). Freva indexes different data projects into one common search environment by storing the meta data information of the self-describing model, reanalysis and observational data sets in a database. This implemented meta data system with its advanced but easy-to-handle search tool supports users, developers and their plugins to retrieve the required information. A generic application programming interface (API) allows scientific developers to connect their analysis tools with the evaluation system independently of the programming language used. Users of the evaluation techniques benefit from the common interface of the evaluation system without any need to understand the different scripting languages. Facilitation of the provision and usage of tools and climate data automatically increases the number of scientists working with the data sets and identifying discrepancies. The integrated webshell (shellinabox) adds a degree of freedom in the choice of the working environment and can be used as a gate to the research projects HPC. Plugins are able to integrate their e.g. post-processed results into the database of the user. This allows e.g. post-processing plugins to feed statistical analysis plugins, which fosters an active exchange between plugin developers of a research project. Additionally, the history and configuration sub-systemstores every analysis performed with the evaluation system in a database. Configurations and results of the toolscan be shared among scientists via shell or web system. Therefore, plugged-in tools benefit from transparency and reproducibility. Furthermore, if configurations match while starting an evaluation plugin, the system suggests touse results already produced by other users – saving CPU/h, I/O, disk space and time. The efficient interaction between different technologies improves the Earth system modeling science framed by Freva.</p><p>New Features and aspects of further development and collaboration are discussed.</p><p> </p>

2021 ◽  
Author(s):  
Etor E. Lucio-Eceiza ◽  
Christopher Kadow ◽  
Martin Bergemann ◽  
Mahesh Ramadoss ◽  
Sebastian Illing ◽  
...  

<p>The Free Evaluation System Framework (Freva - freva.met.fu-berlin.de , xces.dkrz.de , www-regiklim.dkrz.de - https://github.com/FREVA-CLINT/Freva) is a software infrastructure for standardized data and tool solutions in Earth system science. Freva runs on high performance computers (HPC) to handle customizable evaluation systems of research projects, institutes or universities. It combines different software technologies into one common hybrid infrastructure, where all its features are accessible via shell and web environment. Freva indexes different data projects into one common search environment by storing the metadata information of the self-describing model, reanalysis and observational data sets in a database. The database interface satisfies the international standards provided by the Earth System Grid Federation (ESGF). This implemented metadata system with its advanced but easy-to-handle search tool supports users, developers and their plugins to retrieve the required information. A generic application programming interface (API) allows scientific developers to connect their analysis tools with the evaluation system independently of the programming language used. Facilitation of the provision and usage of tools and climate data automatically increases the number of scientists working with the data sets and identifying discrepancies. Plugins are also able to integrate their e.g. post-processed results into the database of the user. This allows e.g. post-processing plugins to feed statistical analysis plugins, which fosters an active exchange between plugin developers of a research project. Additionally, the history and configuration sub-system stores every analysis performed with the evaluation system in a database. Configurations and results of the tools can be shared among scientists via shell or web system. Therefore, plugged-in tools benefit from transparency and reproducibility. Furthermore, the system suggests existing results already produced by other users – saving CPU hours, I/O, disk space and time. An integrated web shell (shellinabox) adds a degree of freedom in the choice of the working environment and can be used as a gate to the research projects on a HPC. Freva efficiently frames the interaction between different technologies thus improving the Earth system modeling science. New Features and aspects of further development and collaboration are discussed.</p>


2021 ◽  
Author(s):  
Etor E. Lucio-Eceiza ◽  
Christopher Kadow ◽  
Martin Bergemann ◽  
Mahesh Ramadoss ◽  
Brian Lewis ◽  
...  

<p>The number of damaging events caused by natural disasters are increasing because of climate change. Projects of public interest such as ClimXtreme (Climate Change and Extreme Events [1, 2]), aim to improve our knowledge of extreme events, the influence of environmental changes and their societal impacts.</p> <p>ClimXtreme takes a holistic approach this problem through different knowledge areas. For that, projects like this need a coordinate effort from many interdisciplinary groups. On the other hand, the continuous improvement of numerical models and increase on observational data availability provides researchers with a growing amount of data to analyze, and the need for greater resources to host, access, and evaluate them efficiently through High Performance Computing (HPC) infrastructures is growing more than ever. Finally, the emphasis these last years on FAIR data principles [3] and the easy reproducibility of evaluation workflows also requires a framework that facilitates these tasks. Freva (Free Evaluation System Framework [4, 5]) is an efficient solution to handle customizable evaluation systems of large research projects, institutes or universities in the Earth system community [6-8] over the HPC environment and in a centralized manner.</p> <p>Freva is a scientific software infrastructure for standardized data and analysis tools (plugins) that provides all its available features both in a shell and web environment. Written in python, is equipped with a standardized model database, an application-programming interface (API) and a history of evaluations, among others:</p> <ul> <li>An implemented metadata system in SOLR with its own search tool allows scientists and their plugins to retrieve the required information from a centralized database. The databrowser interface satisfies the international standards provided by the Earth System Grid Federation (ESGF, e.g. [9]).</li> <li>An API allows scientific developers to connect their plugins with the evaluation system independently of the programming language. The connected plugins are able to access from and integrate their results back to the database, allowing for a concatenation of plugins as well. This ecosystem increases the number of scientists involved in the studies, boosting the interchange of results and ideas. It also fosters an active collaboration between plugin developers.</li> <li>The history and configuration sub-system stores every analysis performed with Freva in a MySQL database. Analysis configurations and results can be searched and shared among the scientists, offering transparency and reproducibility, and saving CPU hours, I/O, disk space and time.</li> </ul> <p>The usage of Freva in the context of ongoing large projects like ClimXtreme will be discussed. Additionally, major updates of the software, system deployment, and core functionalities will be presented.</p> <p><strong> </strong></p> <p><strong>References:</strong></p> <p>[1] https://www.fona.de/de/massnahmen/foerdermassnahmen/climxtreme.php</p> <p>[2] https://www.climxtreme.net/index.php/en/</p> <p>[3] https://www.go-fair.org/fair-principles/</p> <p>[4] Kadow, C. et al. , 2021. Introduction to Freva – A Free Evaluation System Framework for Earth System Modeling. <em>JORS</em>. http://doi.org/10.5334/jors.253</p> <p>[5] gitlab.dkrz.de/freva</p> <p>[6] freva.met.fu-berlin.de</p> <p>[7] https://www.xces.dkrz.de/</p> <p>[8] www-regiklim.dkrz.de</p> <p>[9] https://esgf-data.dkrz.de/projects/esgf-dkrz/</p>


2019 ◽  
Vol 9 (4) ◽  
pp. 189
Author(s):  
Xiaoping Huang ◽  
Yang-Zi Chen

In the construction of “Double First-Class” universities, how to establish an evaluation system of universities’ scientific and technological innovation capacity with Chinese characteristics and international standards will determine the direction and level of improvement of Chinese university’s technological innovation capacity. The system of scientific and technological innovation in university is a complex system, and the existing evaluation index and evaluation system may be difficult to meet the actual needs of the national construction of “Double First-Class” universities in the new situation, so the evaluation index should be a breakthrough and innovation. This paper probes into the existing problems in the evaluation system of scientific research in China, systematically investigate the common and different features of scientific research evaluation in Britain, America, France and Australia, puts forward the new connotation of the structure dimension of Chinese universities’ scientific and technological innovation capacity, and points out the basic criterion of constructing the evaluation system of university scientific and technological innovation capacity: First, design of indicators should reflect the development trend of the world, and reflect the cultural characteristics and historical background of Chinese universities. Second, it is necessary to according to the “world standard”, reflect the value orientation and practice standard of Chinese university construction. Third, taking differentiated design and establishing a classification evaluation standard. Fourth, the evaluative dimension should reflect the diversification of evaluation content, especially considering to optimize overall scientific research ecology.


2021 ◽  
Vol 9 ◽  
Author(s):  
Christopher Kadow ◽  
Sebastian Illing ◽  
Etor E. Lucio-Eceiza ◽  
Martin Bergemann ◽  
Mahesh Ramadoss ◽  
...  

2011 ◽  
Vol 4 (1) ◽  
pp. 27-70 ◽  
Author(s):  
Th. Gruber ◽  
J. L. Bamber ◽  
M. F. P. Bierkens ◽  
H. Dobslaw ◽  
M. Murböck ◽  
...  

Abstract. Time variable gravity fields, reflecting variations of mass distribution in the system Earth is one of the key parameters to understand the changing Earth. Mass variations are caused either by redistribution of mass in, on or above the Earth's surface or by geophysical processes in the Earth's interior. The first set of observations of monthly variations of the Earth gravity field was provided by the US/German GRACE satellite mission beginning in 2002. This mission is still providing valuable information to the science community. However, as GRACE has outlived its expected lifetime, the geoscience community is currently seeking successor missions in order to maintain the long time series of climate change that was begun by GRACE. Several studies on science requirements and technical feasibility have been conducted in the recent years. These studies required a realistic model of the time variable gravity field in order to perform simulation studies on sensitivity of satellites and their instrumentation. This was the primary reason for the European Space Agency (ESA) to initiate a study on "Monitoring and Modelling individual Sources of Mass Distribution and Transport in the Earth System by Means of Satellites". The goal of this interdisciplinary study was to create as realistic as possible simulated time variable gravity fields based on coupled geophysical models, which could be used in the simulation processes in a controlled environment. For this purpose global atmosphere, ocean, continental hydrology and ice models were used. The coupling was performed by using consistent forcing throughout the models and by including water flow between the different domains of the Earth system. In addition gravity field changes due to solid Earth processes like continuous glacial isostatic adjustment (GIA) and a sudden earthquake with co-seismic and post-seismic signals were modelled. All individual model results were combined and converted to gravity field spherical harmonic series, which is the quantity commonly used to describe the Earth's global gravity field. The result of this study is a twelve-year time-series of 6-hourly time variable gravity field spherical harmonics up to degree and order 180 corresponding to a global spatial resolution of 1 degree in latitude and longitude. In this paper, we outline the input data sets and the process of combining these data sets into a coherent model of temporal gravity field changes. The resulting time series was used in some follow-on studies and is available to anybody interested via a Website.


2021 ◽  
Vol 48 (3) ◽  
pp. 581-594
Author(s):  
Songqi PAN ◽  
Caineng ZOU ◽  
Yong LI ◽  
Zhenhua JING ◽  
Entao LIU ◽  
...  

2011 ◽  
Vol 3 (1) ◽  
pp. 19-35 ◽  
Author(s):  
Th. Gruber ◽  
J. L. Bamber ◽  
M. F. P. Bierkens ◽  
H. Dobslaw ◽  
M. Murböck ◽  
...  

Abstract. Time variable gravity fields, reflecting variations of mass distribution in the system Earth is one of the key parameters to understand the changing Earth. Mass variations are caused either by redistribution of mass in, on or above the Earth's surface or by geophysical processes in the Earth's interior. The first set of observations of monthly variations of the Earth gravity field was provided by the US/German GRACE satellite mission beginning in 2002. This mission is still providing valuable information to the science community. However, as GRACE has outlived its expected lifetime, the geoscience community is currently seeking successor missions in order to maintain the long time series of climate change that was begun by GRACE. Several studies on science requirements and technical feasibility have been conducted in the recent years. These studies required a realistic model of the time variable gravity field in order to perform simulation studies on sensitivity of satellites and their instrumentation. This was the primary reason for the European Space Agency (ESA) to initiate a study on ''Monitoring and Modelling individual Sources of Mass Distribution and Transport in the Earth System by Means of Satellites''. The goal of this interdisciplinary study was to create as realistic as possible simulated time variable gravity fields based on coupled geophysical models, which could be used in the simulation processes in a controlled environment. For this purpose global atmosphere, ocean, continental hydrology and ice models were used. The coupling was performed by using consistent forcing throughout the models and by including water flow between the different domains of the Earth system. In addition gravity field changes due to solid Earth processes like continuous glacial isostatic adjustment (GIA) and a sudden earthquake with co-seismic and post-seismic signals were modelled. All individual model results were combined and converted to gravity field spherical harmonic series, which is the quantity commonly used to describe the Earth's global gravity field. The result of this study is a twelve-year time-series of 6-hourly time variable gravity field spherical harmonics up to degree and order 180 corresponding to a global spatial resolution of 1 degree in latitude and longitude. In this paper, we outline the input data sets and the process of combining these data sets into a coherent model of temporal gravity field changes. The resulting time series was used in some follow-on studies and is available to anybody interested.


Sign in / Sign up

Export Citation Format

Share Document