loading page

Leveraging and Easing End Users' Climate Data Access by Interfacing Infrastructures
  • +4
  • Christian Page,
  • Wim Som de Cerff,
  • Alessandro Spinuso,
  • Maarten Plieger,
  • Iraklis Klampanos,
  • Malcolm Atkinson,
  • Vangelis Karkaletsis
Christian Page
CERFACS European Centre for Research and Advanced Training in Scientific Computation

Corresponding Author:[email protected]

Author Profile
Wim Som de Cerff
Royal Netherlands Meteorological Institute
Author Profile
Alessandro Spinuso
Royal Netherlands Meteorological Institute
Author Profile
Maarten Plieger
Royal Netherlands Meteorological Institute
Author Profile
Iraklis Klampanos
National Centre for Scientific Research “Demokritos”
Author Profile
Malcolm Atkinson
University of Edinburgh
Author Profile
Vangelis Karkaletsis
National Center for Scientific Research Demokritos
Author Profile

Abstract

End Users of Climate data have nowadays to struggle with accessing the data they need for their research because of the rapid increase in data volumes. The whole climate data archive is expected to reach a volume of 30 Pb in 2018 and up to 2000 Pb in 2022 (estimated). On-demand data processing solutions as close as possible to the data storage are emerging, thanks to newly developed standards, provenance and infrastructures. In Europe several initiatives are taking place to support scientific on-demand data analytics at the European scale. They offer the huge potential of interoperability, as for example the DARE e-science platform (http://project-dare.eu), designed for efficient and traceable development of complex experiments and domain-specific services on the Cloud. Also, the IS-ENES (https://is.enes.org) consortium has developed a platform to ease access to climate data for the climate impact community (C4I: https://climate4impact.eu). The platform is based on existing standards (ISO and OGC), such as WPS (Web Processing Service). DARE will integrate services from the EUDAT CDI, enabling generic access and cross-domain interoperability, as well as providing compliance and integration with the future EOSC platform. The DARE platform will use containerization technologies, so that it can be easily deployed on heterogeneous architectures. A scientific pilot has been designed within the DARE project for the ENES community (climate domain). The objectives are to enable delegation of on-demand computational-intensive calculations to the DARE platform, from the IS-ENES C4I interface, seamlessly. The DARE architecture and the solutions being implemented will be presented, along with the generic and agile approach taken to implement the pilot.