CAPICE
Scientific modeling requires not only running the model itself, but also various preprocessing steps and data acquisition distributed over different computing infrastructures. Usually the user has to access multiple of such infrastructures to prepare a simulation. The goal of this pilot project was to develop an exemplary infrastructure and workflow that would allow simulations to be run across different computing infrastructures without the need for manual intervention by the user, and for preparing the publication of the results.
The exemplary scientific software used was the open-source "Ice Sheet System Model ISSM" (https://doi.org/10.1029/2011JF002140). ISSM is an established and widely used ice sheet model. The software solution that enables the distributed simulation approach is the “Data Analytics Software Framework DASF” (https://dasf.readthedocs.io). DASF is a remote procedure call wrapper library and acts as a message broker, allowing the user to send a message from a local machine to a remote system. This message can then be interpreted to run a simulation, for example. In this way, the user can trigger various processes, such as transferring data from one remote system to another via a data storage service, preprocessing and analyzing the required data, and submitting compute job scripts, e.g. for the job scheduler in slurm.
The CAPICE project may serve as a template for further applications of running domain model codes across different infrastructures with automatized data.
Partner
- Alfred-Wegener Institut, Helmholtz Zentrum für Polar- und Meereswisschenschaften, Bremerhaven, Germany
- Universität Bremen, Bremen, Germany
- Deutsches Zentrum für Luft- und Raumfahrt e.V., Köln Germany
- Leibniz-Rechenzentrum der Bayerischen Akademie für Wissenschaften, München, Germany
- Helmholtz-Zentrum Hereon, Geesthacht, Germany
- Deutsches Klimarechenzentrum, Hamburg, Germany
Further information
- DASF: https://dasf.readthedocs.io
- NFDI4Earth: https://nfdi4earth.de
- Source Code: https://git.rwth-aachen.de/nfdi4earth/pilotsincubatorlab/pilots/capice
Contact
Data Scientist
Helmholtz Coastal Data Center, Data Management Coastal Research, Institute of Carbon Cycles
Phone: +49 (0)4152 87-2126