So tasks running on SGE can submit (sub-)tasks themselves, to avoid using direct subprocesses.
Version: unspecified
Severity: normal
So tasks running on SGE can submit (sub-)tasks themselves, to avoid using direct subprocesses.
Version: unspecified
Severity: normal
Can we have progress on that? Subprocess works poorly for multiple cpu bound sub-task.
Despite some hesitation about possible runaway jobs, this has been done.
Note that the jsub/jstart tools are not available on the exec nodes by design; submitting jobs recursively should be considered an advanced operation and careful consideration of parameters to qsub should be a requirement.