Processing Chain

The Processing Chain is a Python-based workflow tool designed to streamline weather and climate simulations. It facilitates the preparation of essential input data, submission of compute jobs to the queue on CSCS HPC systems, and the implementation of post-processing steps. In addition to supporting standard versions of the COSMO and ICON models, it is equipped to handle various model variants, notably COSMO-GHG (Greenhouse Gas Extension) and ICON-ART (Aerosols and Reactive Trace Gases)

The Processing Chain can be easily customized to meet your specific requirements. This includes defining custom workflows, creating your own simulation cases, and integrating new jobs and auxiliary scripts.

Getting Started

• Feature Overview
• Conda Environment
  • 1. Install Miniconda
  • 2. Create the Conda Environment
  • 3. Store user-specific data
• How to Run
  • Starting the Chain
  • What it Does
  • Test Cases
  • Directory Structure

Configuration

• Code Structure
• Configuration File
  • Configuration Variables
  • Variables to Set in config.yaml
• Namelist and Runscript Templates
  • jobs.tools.write_int2lm_input_art.main()
  • jobs.tools.write_cosmo_input_ghg.main()

Jobs & Workflows

• Overview
• Adding New Jobs

API

• Jobs
  • jobs.biofluxes.main()
  • jobs.check_output.main()
  • jobs.cosmo.main()
  • jobs.emissions.main()
  • jobs.icon.main()
  • jobs.icontools.main()
  • jobs.int2lm.main()
  • jobs.obs_nudging.main()
  • jobs.octe.main()
  • jobs.oem.main()
  • jobs.online_vprm.main()
  • jobs.photo_rate.main()
  • jobs.post_cosmo.main()
  • jobs.post_int2lm.main()
  • jobs.prepare_cosmo.main()
  • jobs.prepare_icon.main()
  • jobs.reduce_output.main()
  • jobs.verify_chain.main()
• Tools
  • jobs.tools.cams4int2cosmo.main()
  • jobs.tools.check_model.check_model()
  • jobs.tools.comp_nc.datasets_equal()
  • jobs.tools.ctnoaa4int2cosmo.main()
  • jobs.tools.mozart2int2lm.main()
  • jobs.tools.reduce_output_start_end.main()
  • jobs.tools.string2char.main()
  • jobs.tools.vprmsplit.main()
  • jobs.tools.write_cosmo_input_ghg.main()
  • jobs.tools.write_int2lm_input_art.main()