Skip to content

Launch and read_atomic_recipe fails for two variables

Hi @vagudets,

Expected Behavior

Trying to launch jobs in sunset in with two variable in order to use the HeatIndex.

Current Behavior

It might be when loading two variables that the read_atomic_recipe fails because the path is not correct and the connection fails. When read_atomic_recipe is running i receive this error in the file output_dir/recipe[...]/logs/slurm/run-recipe[...].err:

Error in file(file, "rt", encoding = fileEncoding) : 
  cannot open the connection
Calls: read_atomic_recipe -> read_yaml -> file
In addition: Warning message:
In file(file, "rt", encoding = fileEncoding) :
  cannot open file '/esarchive/scratch/abojaly/PROJECTS/DEV_HEATINDEX/OUTPUTS_RECIPE/recipe_HI_20251204112703/logs/recipes/atomic_recipe_sys-ECMWF-SEAS51_ref-ERA5_var-tas': No such file or directory
Execution halted

This is the name of the recipe in /esarchive/scratch/abojaly/PROJECTS/DEV_HEATINDEX/OUTPUTS_RECIPE/recipe_HI_20251204112703/logs/recipes/atomic_recipe_sys-ECMWF-SEAS51_ref-ERA5_var-tas hurs_reg-EU_sdate-0601.yml

Steps To Reproduce

'/esarchive/scratch/abojaly/GitLab/sunset/dev_Indicator_HI/WORKFLOW.R'

source("modules/Loading/Loading.R")
source("modules/Units/Units.R")
source("modules/Indicators/Indicators.R")
source("modules/Crossval/Crossval_calibration.R")
source("modules/Crossval/Crossval_metrics.R")
source("modules/Crossval/Crossval_anomalies.R")
source("modules/Visualization/Visualization.R")


# Read recipe
args = commandArgs(trailingOnly = TRUE)
recipe_file <- args[1] #"/esarchive/scratch/abojaly/GitLab/sunset/dev_Indicator_HI/recipe_HI.yml"
recipe <- read_atomic_recipe(recipe_file)

# Load datasets
data_raw <- Loading(recipe)

# Change units
data_units <- Units(recipe, data_raw)

# Indicator
HI <- Indicators(recipe = recipe, data = data_units) #List of all indicators

# Calibration
HI_cal <- Crossval_calibration(recipe, HI)

# Skill Metrics
HI_metrics <- Crossval_metrics(recipe, HI_cal)

# Plot data
recipe$Analysis$Variables$freq <- 'monthly_mean'

Visualization(recipe = recipe, data = HI_cal, 
              skill_metrics = HI_metrics,
              probabilities = HI_cal$probs,
              significance = TRUE)

  • Branch/SUNSET Version: dev_HeatIndex

  • Environment: Nord4

Other Relevant Information

Please find the recipe attached.recipe_HI.yml

Edited by ALBERTO BOJALY CLUA