Minutes from Wrapper Engine Optimization
We want to make the wrapper engine better and more featurefull. As of now, the code utilizes threads and subprocess, as far as I know. For the horizontal case it is even more complicated because it needs to use machine-files to instruct MPI calls to the correct nodes of all the different jobs.
Here I have a list of all the possible tools I can use that will perform this handle of the resources automatically:
- PyCOMPSs, already working on it on an issue in Autosubmit
- DASK
- Apache Mesos
- DIRAC, as proposed by Bruno
Edited by Manuel G. Marciani