Processing Chain 
The Processing Chain is a collection of Python scripts to prepare necessary input data, submit compute jobs to the queue on Piz Daint and to apply post-processing steps to many pre-defined setups of the COSMO and ICON models. In addition to their standard versions, it can als handle several variants of these models, namely COSMO-GHG, COSMO-ART and ICON-ART. The chain can be flexibly adapted according to your needs, e.g., by creating your own case, adding new jobs or custom scripts.
The code is the product of a joint collaboration between Empa and C2SM. It was originally developed by Christoph Knote using pure Bash scripts. In 2018, Empa’s Atmospheric Modelling and Remote Sensing group translated the code into Python, making it more flexible and easier to maintain.
Since 2021, the Processing Chain has been distributed to the entire C2SM community and is being hosted on the C2SM GitHub organisation. Regular testing is done via Jenkins (requires access) to ensure that the code runs stably on the system.
If you need any help, please contact Michael Jähn.
Support Status
The main branch is continuously being tested on Piz Daint.
Features
- Automatic folder structure creation
- Asynchronous job submission
- Easy creation of own cases
- Namelist templates
- Nested runs possible
- Different examples for COSMO and ICON available
- and much more!