Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
S
Slurm
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Releases
Package Registry
Model registry
Operate
Environments
Terraform modules
Monitor
Incidents
Service Desk
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Terms and privacy
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
tud-zih-energy
Slurm
Commits
e49a3e33
Commit
e49a3e33
authored
12 years ago
by
Morris Jette
Browse files
Options
Downloads
Patches
Plain Diff
Update job array web page
parent
241e2660
No related branches found
No related tags found
No related merge requests found
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
doc/html/job_array.shtml
+30
-9
30 additions, 9 deletions
doc/html/job_array.shtml
with
30 additions
and
9 deletions
doc/html/job_array.shtml
+
30
−
9
View file @
e49a3e33
...
@@ -9,13 +9,15 @@ Job arrays offer a mechanism for submitting and managing collections of similar
...
@@ -9,13 +9,15 @@ Job arrays offer a mechanism for submitting and managing collections of similar
jobs.
jobs.
All jobs must have the same initial options (e.g. size, time limit, etc.),
All jobs must have the same initial options (e.g. size, time limit, etc.),
however it is possible to change some of these options after the job has begun
however it is possible to change some of these options after the job has begun
execution using the <i>scontrol update job ...</i> command.
execution using the command<br>
Job arrays are only supported for batch jobs and the array index values are
<i>scontrol update job ...</i></p>
<p>Job arrays are only supported for batch jobs and the array index values are
specified using the <i>--array</i> or <i>-a</i> option of the <i>sbatch</i>
specified using the <i>--array</i> or <i>-a</i> option of the <i>sbatch</i>
command. The option argument can be specific array index values, a range of
command. The option argument can be specific array index values, a range of
index values, and an optional step size as shown in the examples below.
index values, and an optional step size as shown in the examples below.
Note the the minimum index value is zero and the maximum value a Slurm
Note the the minimum index value is zero and the maximum value a Slurm
configuration parameter <i>MaxArraySize</i> minus one.
configuration parameter
(
<i>MaxArraySize</i> minus one
)
.
Jobs which are part of a job array will have the environment variable
Jobs which are part of a job array will have the environment variable
<i>SLURM_ARRAY_ID</i> set to its array index value.</p>
<i>SLURM_ARRAY_ID</i> set to its array index value.</p>
...
@@ -31,14 +33,16 @@ $ sbatch --array=1,3,5,7 -N1 tmp
...
@@ -31,14 +33,16 @@ $ sbatch --array=1,3,5,7 -N1 tmp
$ sbatch --array=1-7:2 -N1 tmp
$ sbatch --array=1-7:2 -N1 tmp
</pre>
</pre>
<h2>Environment Variables</h2>
<h2>
Job ID and
Environment Variables</h2>
<p>Job arrays will have two additional environment variable set.
<p>Job arrays will have two additional environment variable set.
<b>SLURM_ARRAY_JOBID</b> will be set to the first job ID of the array.
<b>SLURM_ARRAY_JOBID</b> will be set to the first job ID of the array.
<b>SLURM_ARRAY_ID</b> will be set to the job array index value.
<b>SLURM_ARRAY_ID</b> will be set to the job array index value.
For example a job submission of this sort <i>sbatch --array=1-3 -N1 tmp</i>
For example a job submission of this sort<br>
will generate a job array containing three jobs. If the sbatch command responds
<i>sbatch --array=1-3 -N1 tmp</i><br>
<i>Submitted batch job 36</i> then the environment variables will be set as
will generate a job array containing three jobs. If the sbatch command responds<br>
<i>Submitted batch job 36</i><br>
then the environment variables will be set as
follows:<br>
follows:<br>
<br>
<br>
SLURM_JOBID=36<br>
SLURM_JOBID=36<br>
...
@@ -54,6 +58,12 @@ SLURM_ARRAY_JOBID=36<br>
...
@@ -54,6 +58,12 @@ SLURM_ARRAY_JOBID=36<br>
SLURM_ARRAY_ID=3<br>
SLURM_ARRAY_ID=3<br>
</p>
</p>
<p>All Slurm commands and APIs recognize the SLURM_JOBID value.
Some commands also recognize the SLURM_ARRAY_JOBID plus SLURM_ARRAY_ID
values separated by an underscore as identifying an element of a job array.
Using the example above, "37" or "36_2" would be equivalent ways to identify
the second array element of job 36.</p>
<h2>File Names</h2>
<h2>File Names</h2>
<p>Two additional options are available to specify a job's stdin, stdout, and
<p>Two additional options are available to specify a job's stdin, stdout, and
...
@@ -62,7 +72,8 @@ stderr file names:
...
@@ -62,7 +72,8 @@ stderr file names:
and
and
<b>%a</b> will be replaced by the value of SLURM_ARRAY_ID (as defined above).
<b>%a</b> will be replaced by the value of SLURM_ARRAY_ID (as defined above).
An example of its use is:<br>
An example of its use is:<br>
<i>sbatch -o "slurm-%A_%a.out" --array=1-3 -N1 tmp</i> which would generated
<i>sbatch -o "slurm-%A_%a.out" --array=1-3 -N1 tmp</i><br>
which would generated
output files names of this sort "slurm-36_1.out", "slurm-36_2.out" and
output files names of this sort "slurm-36_1.out", "slurm-36_2.out" and
"slurm-36_3.out".
"slurm-36_3.out".
If these file name options are used without being part of a job array then
If these file name options are used without being part of a job array then
...
@@ -83,6 +94,10 @@ $ scancel 20_3 20_5
...
@@ -83,6 +94,10 @@ $ scancel 20_3 20_5
$ scancel 20
$ scancel 20
</pre>
</pre>
<h2>Squeue and Sview Command Use</h2>
<p>TBD</p>
<h2>Scontrol Command Use</h2>
<h2>Scontrol Command Use</h2>
<p>When a job array is submitted using the <i>sbatch</i> command an independent
<p>When a job array is submitted using the <i>sbatch</i> command an independent
...
@@ -109,6 +124,12 @@ JobId=15 ArrayJobId=13 ArrayTaskId=3 Name=tmp
...
@@ -109,6 +124,12 @@ JobId=15 ArrayJobId=13 ArrayTaskId=3 Name=tmp
$ scontrol update JobId=15 TimeLimit=30
$ scontrol update JobId=15 TimeLimit=30
</pre>
</pre>
<p style="text-align:center;">Last modified 23 January 2013</p>
<h2>Other Command Use</h2>
<p>The following Slurm commands do not currently recognize job arrays and their
use requires the use of SLurm job IDs, which are unique for each array element:
sacct, sattach, sbcast, smap, sprio, sreport, sshare, sstat and strigger.</p>
<p style="text-align:center;">Last modified 24 January 2013</p>
<!--#include virtual="footer.txt"-->
<!--#include virtual="footer.txt"-->
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment