Mars and Venus Exploration: A mapping, visualisation, and data analysis application for SPICAM/V high-level science data products

In the era of big data and cloud storage and computing, new ways for scientists to approach their research are emerging, which impact directly how science progresses and discoveries are made. This development has led the European Space Agency (ESA) to establish a reference framework for space mission operation and exploitation by scientific communities: the ESA Datalabs (EDL). The guiding principle of the EDL concept is to move the user to the data and tools, and to enable users to publish applications (e.g. processors, codes, pipelines, analysis and visualisation tools) within a trusted environment, close to the scientific data, and permitting the whole scientific community to discover new science products in an open and FAIR approach. In this context we will present a proto-type science application (aka Sci-App) for the exploration and visualization of Mars and Venus using the SPICAM/V Level-2 data available from the ESA Planetary Science Archive (PSA). This demonstrator facilitates the extraction and compilation of scientific data from the PSA and ease their integration with other tools through VO interoperability thus increasing their scientific impact. The tool&#8217;s key modular functionalities are 1) interactive data query and retrieval (i.e. search archive metadata), 2) interactive visualisation (i.e. geospatial info of query results, data content display of spectra, atmospheric vertical profiles), 3) data manipulation (i.e. create local maps or data cubes), and 4) data analysis (in combination with other connected VO tools). The application allows users to select, visualise and analyse both Level 2A products, which consist of e.g. transmission and radiance spectra, and level 2B products, which consist of retrieved physical parameters, such as atmospheric aerosol properties and vertical density profiles for (trace) gases in the Martian or Venusian atmosphere. Our goal is to deploy the (containerised) Sci-App to the EDL and similar initiatives for uptake by the space science community. In the future, we expect to incorporate access to other Mars/Venus atmospheric data sets, particularly the measurements obtained with the NOMAD and ACS instruments on the ExoMars Trace Gas Orbiter. The community can also use this application as a starting point for their own tool development for other data products/missions.

Download Full-text

Streamlining Oceanic Biogeochemical Dataset Assembly in Support of Global Data Products

10.5194/egusphere-egu2020-11709 ◽

2020 ◽

Author(s):

Eugene Burger ◽

Benjamin Pfeil ◽

Kevin O'Brien ◽

Linus Kamb ◽

Steve Jones ◽

...

Keyword(s):

Quality Control ◽

Data Integration ◽

Scientific Data ◽

Climate Data ◽

Science Data ◽

Metadata Record ◽

Data Products ◽

Analysis And Synthesis ◽

Data Integration System ◽

Global Data

Data assembly in support of global data products, such as GLODAP, and submission of data to national data centers to support long-term preservation, demands significant effort. This is in addition to the effort required to perform quality control on the data prior to submission. Delays in data assembly can negatively affect the timely production of scientific indicators that are dependent upon these datasets, including products such as GLODAP. What if data submission, metadata assembly and quality control can all be rolled into a single application? To support more streamlined data management processes in the NOAA Ocean Acidification Program (OAP) we are developing such an application.This application has the potential for application towards a broader community.This application addresses the need that data contributing to analysis and synthesis products are high quality, well documented, and accessible from the applications scientists prefer to use. The Scientific Data Integration System (SDIS) application developed by the PMEL Science Data Integration Group, allows scientists to submit their data in a number of formats. Submitted data are checked for common errors. Metadata are extracted from the data that can then be complemented with a complete metadata record using the integrated metadata entry tool that collects rich metadata that meets the Carbon science community requirements. Still being developed, quality control for standard biogeochemical parameters will be integrated into the application. The quality control routines will be implemented in close collaboration with colleagues from the Bjerknes Climate Data Centre (BCDC) within the Bjerknes Centre for Climate Research (BCCR).&#160; This presentation will highlight the capabilities that are now available as well as the implementation of the archive automation workflow, and it&#8217;s potential use in support of GLODAP data assembly efforts.

Download Full-text

ESA’s Planetary Science Archive efforts to support the scientific community

10.5194/epsc2021-18 ◽

2021 ◽

Author(s):

Sébastien Besse ◽

Isa Barbarisi ◽

Guido de Marchi ◽

Bruno Merin ◽

Javier Arenas ◽

...

Keyword(s):

Scientific Community ◽

European Space Agency ◽

Planetary Science ◽

Scientific Data ◽

Geographical Information ◽

Storage Facility ◽

The Moon ◽

Mars Express ◽

Geometrical Information ◽

Comet 67P

Introduction:&#160; With new missions being selected, missions moving to post-operations, and missions starting their journey to various targets in the Solar System, the European Space Agency&#8217;s Planetary Science Archive [1] (http://psa.esa.int) (PSA) is in constant evolution to support the needs of the projects and of the scientific community. Geometry as a key input for users:&#160; While analysing the various services that the PSA already offers, geometrical information was lacking in many ways. Feedback received by the users and the PSA User Group pointed to improvements in this area.&#160; During the past years, the PSA structured its internal architecture to provide excellent services to the community. Through external partnership, we developed the GEOmetry GENerator that allows a consistent way of deriving geometrical information. This input provides a solid foundation to develop Geographical Information System (GIS) services into the PSA. At the end of 2020, the PSA released its 3D and 2D interfaces for Mars Express and Rosetta, providing a new generation of geometrical services. Although currently focused on Mars and comet 67P/C-G, our architecture enables a rapid growth to support in particular BepiColombo and JUICE. High level products through the Guest Storage Facility: One of the other new service provided to the scientific community recently is the Guest Storage Facility (GSF), which allows users to store derived products. Products such as geological maps, Digital Terrain Models, new calibrated files, and others can be stored in the GSF in the format most used by the users. The philosophy of the GSF service is to impose minimum requirements on the data producers, while delivering maximum usability to the end users. Various products related to Titan and Mars are available in the GSF. Products related to the Moon, comet 67P/C-G and other targets are in preparation. Contact us to preserve your science!&#160; Interact with the PSA and expect more in the years to come: The PSA aims to build on the previous development to further enrich its services. New GIS interfaces related to Phobos, the Moon and Mars are in development to facilitate the searching capabilities on those targets. In parallel to those major developments, new functionalities will be developed to support ESA missions, in particular ExoMars, Mars Express, and BepiColombo. At the PSA we constantly interact with our users to ensure that our services are in line with the expectations and needs of the community (despite massive disruptions in 2019 and 2020). We encourage feedback from community scientists through: <ul class="ul1"> <li class="li3">PSA Users Group: A group of scientific experts advising the PSA on strategic development;</li> <li class="li3">Direct interactions: Scientists from the PSA are available and eager to receive your comments and suggestions;</li> <li class="li3">ESA missions: If you are part of a mission archiving its data at the PSA, tell us how your data should best be searched and used.</li> </ul> Acknowledgments: The authors are very grateful to all the people who have contributed over the last 18 years to ESA's Planetary Science Archive. We are also thankful to ESA&#8217;s teams who are operating the missions and to the instrument science teams who are generating and delivering scientific calibrated products to the archive. References: [1] Besse, S. et al. (2017) Planetary and Space Science, 10.1016/j.pss.2017.07.013, ESA's Planetary Science Archive: Preserve and present reliable scientific data sets.

Download Full-text

A NEO Physical Properties database within the NEOROCKS EU project

10.5194/epsc2020-1047 ◽

2020 ◽

Author(s):

Alessio Giunta ◽

Marco Giardino ◽

Ettore Perozzi ◽

Gianluca Polenta ◽

Angelo Zinzi ◽

...

Keyword(s):

Physical Properties ◽

Planetary Science ◽

Physical Characterization ◽

Data Repository ◽

Physical Parameters ◽

Wide Field ◽

Horizon 2020 ◽

Data Products ◽

Eu Project

The advent of new wide field, ground-based and multiwavelength space based sky surveys will lead to a large amount of data that needs to be efficiently processed, archived and disseminated. In addition, differently from astrometric observations which have a centralized data repository acting under IAU mandate (the MPC), the outcome of ground-based NEO observations devoted to NEO physical characterization are sparsely distributed. It appears then desirable to have data on NEO physical characterization available through a centralized access able to guarantee their long-term archiving, as well as to ensure the maintenance and the evolution of the corresponding data products. &#160; &#160; Within the NEOROCKS EU project (&#8220;The NEO Rapid Observation, Characterization and Key Simulations&#8221; - SU-SPACE-23-SEC-2019 from the Horizon 2020), as part of WP5 (Data Management) activities, we propose the implementation of a unique NEO Physical Properties database hosting all different data products resulting from NEO observations devoted to physical characterization, in order to ensure an efficient data products dissemination and their short/long-term storage and availability. The NEOROCKS database, will be designed by means of an EPNCore derived data model (see [1]) ready for the EPN-TAP service implementation, and thus able to store, maintain and regularly update all different levels of processing, from raw data to final products (e.g. size, rotation, spectral type) beyond the duration of the project as an reliable source of services and data on NEO physical properties hosted at ASI SSDC. &#160; The NEOROCKS database will import NEO orbital elements from the Near-Earth Object Dynamics Site (NEODyS), while NEO physical parameters will be partly provided by NEOROCKS users, partly imported from external data source. In particular, the NEO physical properties database available at the ESA NEO Coordination Center, hosting since 2013 the legacy of the European Asteroid Research Node (EARN) and which will host Solar System Objects (SSO) NEO physical properties in the Gaia DR3 expected for the second half of 2021, will be imported and integrated into the NEOROCKS Physical Properties Database. Thus, a single query interface will allow to display both dynamical and physical properties of any given NEO, or to search for samples within the NEO population satisfying certain requirements (e.g. targets for astronomical observations and mission analysis). &#160; Acknowledgements: The LICIACube team acknowledges financial support from Agenzia Spaziale Italiana (ASI, contract No. 2019-31-HH.0 CUP F84I190012600). &#160; &#160; References &#160; [1] Erard S., Cecconi B., Le Sidaner P., Berthier J., Henry F., Molinaro M., Giardino M., Bourrel N., Andre N., Gangloff M., Jacquey C., Topf F. 2014. The EPN-TAP protocol for the Planetary Science Virtual Observatory (2014). Astronomy And Computing, vol. 7-8, p. 52-61, ISSN: 2213-1337, doi: 10.1016/j.ascom.2014.07.008

Download Full-text

Open Universe for Blazars: a new generation of astronomical products based on 14 years of Swift-XRT data

Astronomy and Astrophysics ◽

10.1051/0004-6361/201935646 ◽

2019 ◽

Vol 631 ◽

pp. A116 ◽

Cited By ~ 9

Author(s):

P. Giommi ◽

C. H. Brandt ◽

U. Barres de Almeida ◽

A. M. T. Pollock ◽

F. Arneodo ◽

...

Keyword(s):

Data Analysis ◽

Data Science ◽

High Energy ◽

Space Mission ◽

Science Data ◽

Spectral Parameters ◽

Data Set ◽

X Ray ◽

Research Education ◽

Open Universe

Aims. Open Universe for Blazars is a set of high-transparency multi-frequency data products for blazar science, and the tools designed to generate them. Blazars are drawing growing interest following the consolidation of their position as the most abundant type of source in the extragalactic very high-energy γ-ray sky, and because of their status as prime candidate sources in the nascent field of multi-messenger astrophysics. As such, blazar astrophysics is becoming increasingly data driven, depending on the integration and combined analysis of large quantities of data from the entire span of observational astrophysics techniques. The project was therefore chosen as one of the pilot activities within the United Nations Open Universe Initiative, whose objective is to stimulate a large increase in the accessibility and ease of utilisation of space science data for the worldwide benefit of scientific research, education, capacity building, and citizen science. Methods. Our aim is to deliver innovative data science tools for multi-messenger astrophysics. In this work we report on a data analysis pipeline called Swift-DeepSky based on the Swift XRTDAS software and the XIMAGE package, encapsulated into a Docker container. Swift-DeepSky downloads and reads low-level data, generates higher level products, detects X-ray sources, and estimates several intensity and spectral parameters for each detection, thus facilitating the generation of complete and up-to-date science-ready catalogues from an entire space-mission data set. Results. As a first application of our innovative approach, we present the results of a detailed X-ray image analysis based on Swift-DeepSky that was run on all Swift-XRT observations including a known blazar, carried out during the first 14 years of operations of the Neil Gehrels Swift Observatory. Short exposures executed within one week of each other have been added to increase sensitivity, which ranges between ∼1 × 10−12 and ∼1 × 10−14 erg cm−2 s−1 (0.3–10.0 keV). After cleaning for problematic fields, the resulting database includes over 27 000 images integrated in different X-ray bands, and a catalogue, called 1OUSXB, that provides intensity and spectral information for 33 396 X-ray sources, 8896 of which are single or multiple detections of 2308 distinct blazars. All the results can be accessed online in a variety of ways, from the Open Universe portal through Virtual Observatory services, via the VOU-Blazar tool and the SSDC SED builder. One of the most innovative aspects of this work is that the results can be easily reproduced and extended by anyone using the Docker version of the Swift-DeepSky pipeline, which runs on Linux, Mac, and Windows machines, and does not require any specific experience in X-ray data analysis.

Download Full-text

ESA’s Planetary Science Archive, updates since last year!

10.5194/epsc2020-921 ◽

2020 ◽

Author(s):

Sébastien Besse ◽

Isa Barbarisi ◽

Guido de Marchi ◽

Bruno Merin ◽

Javier Arenas ◽

...

Keyword(s):

Solar System ◽

Geographical Information Systems ◽

Scientific Community ◽

European Space Agency ◽

Planetary Science ◽

Scientific Data ◽

Geographical Information ◽

Data Sets ◽

Space Agency ◽

Search Data

Abstract With new missions being selected, missions moving to post-operations, and missions starting their journey to various targets in the Solar System, the European Space Agency&#8217;s Planetary Science Archive [1] (http://psa.esa.int) (PSA) is in constant evolution to support the needs of the projects and of the scientific community. What happened since last year? The past year has been good for the European Space Agency (ESA) Solar System missions and the PSA, with the successful flyby of Earth by the BepiColombo mission to Mercury. The ExoMars 2016 mission is performing nominally and is quickly delivering numerous scientific observations. As is common for ESA missions, access to the data is protected and reserved to members of the science team for the first months of the mission. Once the products are ready to go public, the PSA performs a scientific peer-review to ensure that the products to be made public are of excellent quality for all future users. During the first half of 2020, the PSA has successfully peer-reviewed the CaSSIS and NOMAD observations. Those products are now being made public on a systematic basis once the proprietary period elapses (generally between 6 and 12 months). Early in 2020, filters to search data with geometrical values (i.e., longitude, phase angle, slant distance, etc.) were enabled. For now this service works for Mars Express and Rosetta, but will be soon extended to other missions. One of the main new services provided to the scientific community in 2020 is the Guest Storage Facility (GSF), which allows users to archive derived products. Products such as geological maps, Digital Terrains Models, new calibrated files, and others can be stored in the GSF in the format most used by the users. Contact us to preserve your science! Finally, by the end of 2020 users of the PSA will have access to new services based on Geographical Information Systems. You can contribute to the PSA! At the PSA we constantly interact with our users to ensure that our services are in line with the expectations and needs of the community. We encourage feedback from community scientists through: <ul> <li>PSA Users Group: A group of scientific experts advising the PSA on strategic development;</li> <li>Direct interactions: Scientists from the PSA are available and eager to receive your comments and suggestions;</li> <li>ESA missions: If you are part of a mission archiving its data at the PSA, tell us how your data should best be searched and used.</li> </ul> Acknowledgement The authors are very grateful to all the people who have contributed over the last 17 years to ESA's Planetary Science Archive. We are also thankful to ESA&#8217;s teams who are operating the missions and to the instrument science teams who are generating and delivering scientific calibrated products to the archive. References [1] Besse, S. et al. (2017) Planetary and Space Science, 10.1016/j.pss.2017.07.013, ESA's Planetary Science Archive: Preserve and present reliable scientific data sets.

Download Full-text

Using the ESA’s Planetary Science Archive to Search for Mars Express VMC Data of an Elongated Cloud near Arsia Mons

10.5194/egusphere-egu21-3374 ◽

2021 ◽

Author(s):

Emmanuel Grotheer ◽

Keyword(s):

User Interface ◽

European Space Agency ◽

Planetary Science ◽

Scientific Data ◽

Public Attention ◽

Mars Express ◽

The Public ◽

Processing Level ◽

Public Data ◽

Planetary Missions

Introduction: The European Space Agency&#8217;s (ESA) Mars Express (MEX) mission to Mars has been returning valuable scientific data for ~17 years. &#160;This data is available to the public for free via the Planetary Science Archive (PSA), which houses the raw, calibrated, and higher-level data returned by the ESA&#8217;s planetary missions, including data provided by the various MEX instrument teams. &#160;The Visual Monitoring Camera (VMC) was originally used to monitor the deployment of the Beagle 2 lander. &#160;In recent years, these images have been worked on by a science team from Bilbao for scientific research. &#160;These raw and processed images of this new &#8216;8th instrument&#8217; have been included in the PSA, including observations of an elongated cloud near Arsia Mons that garnered considerable public attention [1]. &#160;In this presentation we will show how to use the PSA user interface to find this data. The PSA user interfaces: The ESA&#8217;s PSA uses the Planetary Data System (PDS) format developed by NASA to store the data from its various planetary missions. &#160;In the case of MEX, the data is stored in the PDS3 format, which primarily uses ASCII files to store and describe the data. &#160;There are two primary ways in which to find the data. &#160;One is the FTP area, which houses all the public data in the PSA. &#160;Here, there are no advanced search capabilities, but it does provide access to all the supporting files and documentation for the various datasets. &#160;When first searching for new data, users would benefit from using the web-based search interfaces [2]. &#160;Here the user can search using various parameters, such as mission name, target (e.g. Mars), instrument name, processing level, observation times, etc. &#160;The development of the PSA&#8217;s search capabilities continues, thus more search parameters continue to be added. &#160;The Image View interface is particularly helpful when looking through browse images provided by the instrument teams. &#160;Recently, a prototype of a new Map View has been made public, in which most of the MEX data can be seen. &#160;These various search methods rely on the metadata provided by the instrument teams in the labels associated with each of the data products.Access and Feedback: All this data can be freely accessed at the ESA&#8217;s PSA, at https://archives.esac.esa.int/psa/. &#160;There are multiple ways of browsing the data. &#160;The development of the PSA&#8217;s user interface is an ongoing project, and we welcome feedback from the community for suggestions on new ways to search this wealth of data. &#160;Feedback and suggestions can be sent to [email protected].References:&#160; [1] Bauer M. (2018, October 25) ESA Science & Exploration. Mars Express keeps an eye on curious cloud. Retrieved from http://www.esa.int/Science_Exploration/Space_Science/Mars_Express/Mars_Express_keeps_an_eye_on_curious_cloud [2] Besse S., Vallat C., Barthelemy M., Coia D., Costa M., De Marchi G., Fraga D., Grotheer E., Heather D., Lim T., Martinez S., Arviset C., Barbarisi I., Docosal R., Macfarlane A., Rios C., Saiz J., and Vallejo F. (2018) Planetary and Space Science, Vol. 150, pp. 131-140.

Download Full-text

The Euclid Data Processing Challenges

Proceedings of the International Astronomical Union ◽

10.1017/s1743921317001521 ◽

2016 ◽

Vol 12 (S325) ◽

pp. 73-82 ◽

Cited By ~ 3

Author(s):

Pierre Dubath ◽

Nikolaos Apostolakos ◽

Andrea Bonchi ◽

Andrey Belikov ◽

Massimo Brescia ◽

...

Keyword(s):

Data Analysis ◽

Software Development ◽

Data Processing ◽

Data Center ◽

Near Infrared ◽

Space Mission ◽

Science Data ◽

Operational Data ◽

Infrared Survey

AbstractEuclid is a Europe-led cosmology space mission dedicated to a visible and near infrared survey of the entire extra-galactic sky. Its purpose is to deepen our knowledge of the dark content of our Universe. After an overview of the Euclid mission and science, this contribution describes how the community is getting organized to face the data analysis challenges, both in software development and in operational data processing matters. It ends with a more specific account of some of the main contributions of the Swiss Science Data Center (SDC-CH).

Download Full-text

Prisma: A New Space Mission For Stellar Physics

International Astronomical Union Colloquium ◽

10.1017/s0252921100018960 ◽

1993 ◽

Vol 137 ◽

pp. 812-819

Author(s):

T. Appourchaux ◽

D. Gough ◽

P. Hyoyng ◽

C. Catala ◽

S. Frandsen ◽

...

Keyword(s):

European Space Agency ◽

Real Space ◽

Space Mission ◽

Economic Conditions ◽

X Ray ◽

Space Agency ◽

New Space

PRISMA (Probing Rotation and Interior of Stars: Microvariability and Activity) is a new space mission of the European Space Agency. PRISMA is currently in a Phase A study with 3 other competitors. PRISMA is the only ESA-only mission amongst those four and only one mission will be selected in Spring 1993 to become a real space mission.The goal of the Phase A study is to determine whether the payload of PRISMA can be accommodated on a second unit of the X-ray Multi-Mirror (XMM) bus; and whether the budget of the PRISMA mission can be kept below 265 MAU (’88 Economic conditions). The XMM mission is an approved cornerstone and is in a Phase A together with PRISMA.

Download Full-text

Establishing a consensus for the hallmarks of cancer based on gene ontology and pathway annotations

BMC Bioinformatics ◽

10.1186/s12859-021-04105-8 ◽

2021 ◽

Vol 22 (1) ◽

Author(s):

Yi Chen ◽

Fons. J. Verbeek ◽

Katherine Wolstencroft

Keyword(s):

Gene Ontology ◽

Enrichment Analysis ◽

Biological Data ◽

Hallmarks Of Cancer ◽

High Throughput Analysis ◽

Knowledge Resources ◽

Gene Set ◽

Cancer Hallmarks ◽

Starting Point ◽

High Level

Abstract Background The hallmarks of cancer provide a highly cited and well-used conceptual framework for describing the processes involved in cancer cell development and tumourigenesis. However, methods for translating these high-level concepts into data-level associations between hallmarks and genes (for high throughput analysis), vary widely between studies. The examination of different strategies to associate and map cancer hallmarks reveals significant differences, but also consensus. Results Here we present the results of a comparative analysis of cancer hallmark mapping strategies, based on Gene Ontology and biological pathway annotation, from different studies. By analysing the semantic similarity between annotations, and the resulting gene set overlap, we identify emerging consensus knowledge. In addition, we analyse the differences between hallmark and gene set associations using Weighted Gene Co-expression Network Analysis and enrichment analysis. Conclusions Reaching a community-wide consensus on how to identify cancer hallmark activity from research data would enable more systematic data integration and comparison between studies. These results highlight the current state of the consensus and offer a starting point for further convergence. In addition, we show how a lack of consensus can lead to large differences in the biological interpretation of downstream analyses and discuss the challenges of annotating changing and accumulating biological data, using intermediate knowledge resources that are also changing over time.

Download Full-text

Traditional Applications of Tannin Rich Extracts Supported by Scientific Data: Chemical Composition, Bioavailability and Bioaccessibility

Foods ◽

10.3390/foods10020251 ◽

2021 ◽

Vol 10 (2) ◽

pp. 251

Author(s):

Maria Fraga-Corral ◽

Paz Otero ◽

Lucia Cassani ◽

Javier Echave ◽

Paula Garcia-Oliveira ◽

...

Keyword(s):

Chemical Composition ◽

Chemical Nature ◽

Scientific Evidence ◽

Scientific Data ◽

Attractive Alternative ◽

Chemical Profile ◽

Traditional Use ◽

Starting Point ◽

Scientific Approach ◽

Food Applications

Tannins are polyphenolic compounds historically utilized in textile and adhesive industries, but also in traditional human and animal medicines or foodstuffs. Since 20th-century, advances in analytical chemistry have allowed disclosure of the chemical nature of these molecules. The chemical profile of extracts obtained from previously selected species was investigated to try to establish a bridge between traditional background and scientific data. The study of the chemical composition of these extracts has permitted us to correlate the presence of tannins and other related molecules with the effectiveness of their apparent uses. The revision of traditional knowledge paired with scientific evidence may provide a supporting background on their use and the basis for developing innovative pharmacology and food applications based on formulations using natural sources of tannins. This traditional-scientific approach can result useful due to the raising consumers’ demand for natural products in markets, to which tannin-rich extracts may pose an attractive alternative. Therefore, it is of interest to back traditional applications with accurate data while meeting consumer’s acceptance. In this review, several species known to contain high amounts of tannins have been selected as a starting point to establish a correlation between their alleged traditional use, tannins content and composition and potential bioaccessibility.

Download Full-text