Robert S Weigel

and 18 more

Heliophysics data analysis often involves combining diverse science measurements, many of them captured as time series. Although there are now only a few commonly used data file formats, the diversity in mechanisms for automated access to and aggregation of such data holdings can make analysis that requires inter-comparison of data from multiple data providers difficult. The Heliophysics Application Programmer’s Interface (HAPI) is a recently developed standard for accessing distributed time-series data to increase interoperability. The HAPI specification is based on the common elements of existing data services, and it standardizes the two main parts of a data service: the request interface and the response data structures. The interface is based on the REpresentational State Transfer (REST) or RESTful architecture style, and the HAPI specification defines five required REST endpoints. Data are returned via a streaming format that hides file boundaries; the metadata is detailed enough for the content to be scientifically useful, e.g., plotted with appropriate axes layout, units, and labels. Multiple mature HAPI-related open-source projects offer server-side implementation tools and client-side libraries for reading HAPI data in multiple languages (IDL, Java, MATLAB, and Python). Multiple data providers in the US and Europe have added HAPI access alongside their existing interfaces. Based on this experience, data can be served via HAPI with little or no information loss compared to similar existing web interfaces. Finally, HAPI has been recommended as a COSPAR standard for time series data delivery.

Baptiste Cecconi

and 26 more

The MASER (Measuring, Analysing and Simulating Radio Emissions) project provides a comprehensive infrastructure dedicated to low frequency radio emissions (typically < 50 to 100 MHz). The four main radio sources observed in this frequency are the Earth, the Sun, Jupiter and Saturn. They are observed either from ground (down to 10 MHz) or from space (down to a few kHz). Ground observatories are more sensitive than space observatories and capture high resolution data streams (up to a few TB per day for modern instruments). Conversely, space-borne instruments can observe below the ionospheric cut-off (10 MHz) and can be placed closer to the studied object. Several tools have been developed in the last decade for sharing space physcis data. Data visualization tools developed by the CDPP (http://cdpp.eu, Centre de Données de la Physique des Plasmas, in Toulouse, France) and the University of Iowa (Autoplot, http://autoplot.org) are available to display and analyse space physics time series and spectrograms. A planetary radio emission simulation software is developed in LESIA (ExPRES: Exoplanetary and Planetary Radio Emission Simulator). The VESPA (Virtual European Solar and Planetary Access) provides a search interface that allows to discover data of interest for scientific users, and is based on IVOA standards (astronomical International Virtual Observatory Alliance). The University of Iowa also develops Das2server that allows to distribute data with adjustable temporal resolution. MASER is making use of all these tools and standards to distribute datasets from space and ground radio instruments available from the Observatoire de Paris, the Station de Radioastronomie de Nançay and the CDPP deep archive. These datasets include Cassini/RPWS, STEREO/Waves, WIND/Waves, Ulysses/URAP, ISEE3/SBH, Voyager/PRA, Nançay Decameter Array (Routine, NewRoutine, JunoN), RadioJove archive, swedish Viking mission, Interball/POLRAD… MASER also includes a Python software library for reading raw data. This work is supported by CDPP, CNES, PADC and Europlanet-2020-RI. The Europlanet 2020 Research Infrastructure project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 654208.