You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The EOS workflow example already highlights various aspects of how the engines deal with certain aspects of scientific workflows:
Executing Python code.
Executing external code.
Connecting steps in a workflow.
Running multiple external calculations in parallel.
Waiting for long-running calculations before executing the next step.
Persistance.
And probably more. However, one aspect that isn't covered at the moment is restarts. I.e. what if the second calculation requires access to the full output files of the first?
A typical example here is a band structure calculation, where you would first run an SCF to obtain the charge density, and then an NSCF along a k-path. Quantum ESPRESSO loves working with restarts, typically running multiple different "codes" (it's a code suite, after all). Another example would be the DOS. For this you'd run:
and each restart requires (large) output files from the previous step. So I'm curious to see how other workflow engines specify parent directories, indicate that a follow-up step should wait for the previous, make sure the files are only cleaned up at the end, etc...
Another note: the next step in the verification project (after EOS) is also band structures, i.e. construct a common band structure workflow for various "quantum engines" (Quantum ESPRESSO, VASP, ABINIT, ...) and compare results.
The text was updated successfully, but these errors were encountered:
The EOS workflow example already highlights various aspects of how the engines deal with certain aspects of scientific workflows:
And probably more. However, one aspect that isn't covered at the moment is restarts. I.e. what if the second calculation requires access to the full output files of the first?
A typical example here is a band structure calculation, where you would first run an SCF to obtain the charge density, and then an NSCF along a k-path. Quantum ESPRESSO loves working with restarts, typically running multiple different "codes" (it's a code suite, after all). Another example would be the DOS. For this you'd run:
pw.x
(SCF) ->pw.x
(NSCF) ->dos.x
(post-processing)and each restart requires (large) output files from the previous step. So I'm curious to see how other workflow engines specify parent directories, indicate that a follow-up step should wait for the previous, make sure the files are only cleaned up at the end, etc...
Another note: the next step in the verification project (after EOS) is also band structures, i.e. construct a common band structure workflow for various "quantum engines" (Quantum ESPRESSO, VASP, ABINIT, ...) and compare results.
The text was updated successfully, but these errors were encountered: