Skip to content

Memory issue when loading data

Hi @vagudets and @aho,

I am loading the following hcst and obs data with the verification suite in my Workstation:

*         dat:   1
*         var:   1
*        sday:   1
*       sweek:   1
*       syear:  24
*        time:   6
*    latitude: 180
*   longitude: 360
*    ensemble:  25
* Total size of requested data:
*   1 x 1 x 1 x 1 x 24 x 6 x 180 x 360 x 25 x 8 bytes = 1.7 Gb
*         dat:   1
*         var:   1
*        sday:   1
*       sweek:   1
*       syear:  24
*        time:   6
*    latitude: 180
*   longitude: 360
* Total size of requested data:
*   1 x 1 x 1 x 1 x 24 x 6 x 180 x 360 x 8 bytes = 71.2 Mb

Using the command htop I see that data load takes up 50% of my WS memory, corresponding to 8Gb, four times greater than the data that I am loading.

Could there possibly be some temporal variables being loaded here which are not removed?

This issue is not currently a problem for me, since I can use Nord3 instead, but I just wanted to let you know about it.

Thanks,

Nadia