Skip to content

Autosubmit as workflow manager

#177 (closed)

This development changes several parts in Compute() and Collect(), including:

  • ByChunks() to be renamed to ByChunks_ecflow(), and ByChunks_autosubmit() is created
  • Compute() consider two cases: autosubmit or ecflow
  • Collect() becomes a wrapper of Collect_ecflow() and Collect_autosubmit()
  • inst/chunking/ to have subfolders Autosubmit and ecFlow
  • new Compute() cluster components for Autosubmit

The tested cases: https://earth.bsc.es/gitlab/aho/aho-testtest/-/blob/master/startR/autosubmit/test_autosubmit.R

  • Basic Start() call, function returns data without processing
  • Basic Start() call, function calculating WeightedMean, attributes used
  • Start() call with 2 dats, function calculating WeightedMean, attributes used
  • Start() call with transform, function calculating WeightedMean, attributes used
  • Basic Start() call, return 2 outputs with names (mean and min)

TODO:

  • Change TODO parts
  • Check resource usage (core/processor/threads)
  • Documentation
Edited by aho

Merge request reports

Loading