Skip to content

Draft: Provenance for the Loading and Aggregation module + rocrate provenance when executing jobs with autosubmit

  • Provenance feature for Loading and Aggregation modules: By specifying Provenance: yes in the Analysis section of the recipe, JSON files will be generated and stored in out_dir/outputs/provenance during the workflow execution. These files contain a comprehensive description of the transformations applied to the data using the METACLIP ontologies. As a result, the transformations can be interactively visualized with the METACLIP interpreter.

  • When running multiple jobs with autosubmit, setting the parameter auto_conf$provenance to True triggers the creation of the file rocrate.yml. This file is later used by autosubmit to create a zip archive with ro-crate-metadata.json at the top level. This JSON file includes all the provenance details related to the autosubmit execution. Additionally, it contains the provenance of each individual job, described with METACLIP, as well as the recipes used. For more information: https://earth.bsc.es/gitlab/es/sunset/-/tree/Dev-Provenance/use_cases/ex1_4_provenance_autosubmit.

Merge request reports

Loading