Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
S
Slurm
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Releases
Package Registry
Model registry
Operate
Environments
Terraform modules
Monitor
Incidents
Service Desk
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Terms and privacy
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
tud-zih-energy
Slurm
Commits
118eb95e
Commit
118eb95e
authored
10 years ago
by
Sourav Chakraborty
Committed by
jette
10 years ago
Browse files
Options
Downloads
Patches
Plain Diff
Update MVAPICH2 integration info
parent
40442c8e
No related branches found
No related tags found
No related merge requests found
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
doc/html/mpi_guide.shtml
+26
-8
26 additions, 8 deletions
doc/html/mpi_guide.shtml
doc/html/team.shtml
+1
-0
1 addition, 0 deletions
doc/html/team.shtml
with
27 additions
and
8 deletions
doc/html/mpi_guide.shtml
+
26
−
8
View file @
118eb95e
...
@@ -373,19 +373,37 @@ documentation for "CQ or QP Creation failure".</p>
...
@@ -373,19 +373,37 @@ documentation for "CQ or QP Creation failure".</p>
<h2><a name="mvapich2" href="http://nowlab.cse.ohio-state.edu/projects/mpi-iba"><b>MVAPICH2</b></a></h2>
<h2><a name="mvapich2" href="http://nowlab.cse.ohio-state.edu/projects/mpi-iba"><b>MVAPICH2</b></a></h2>
<p>MVAPICH2 jobs can be launched directly by <b>srun</b> command.
<p>MVAPICH2 supports launching multithreaded programs by Slurm as well as
SLURM's <i>none</i> MPI plugin must be used to establish communications
mpirun_rsh.
between the launched tasks. This can be accomplished either using the SLURM
Please note that if you intend to use use srun, you need to build MVAPICH2
configuration parameter <i>MpiDefault=none</i> in <b>slurm.conf</b>
with Slurm support.
or srun's <i>--mpi=none</i> option. The program must also be linked with
Please refer to the
SLURM's implementation of the PMI library so that tasks can communicate
<a href="http://mvapich.cse.ohio-state.edu/static/media/mvapich/mvapich2-2.0-userguide.html#x1-100004.3.2">
MVAPICH2 User Guide</a> for details.
You can also use Slurm for only resource allocation (using the salloc or sbatch
command) and launch the jobs using mpirun_rsh.
However, please note that mpirun_rsh does not accept "-env" parameter, so
the command would be something like this:</p>
<pre>
$ mpirun_rsh -np 2 -hostfile <path_to_hostfile> \
MV2_USE_CUDA=1 MV2_ENABLE_AFFINITY=0 ./mpi <application>
</pre>
<p>Slurm must be configured to use the <i>none</i> MPI plugin to establish
communications between the launched tasks.
This can be accomplished either using the Slurm configuration parameter
<i>MpiDefault=none</i> in <b>slurm.conf</b> or srun's <i>--mpi=none</i> option.
<b>Do not use Slurm's MVAPICH plugin for MVAPICH2.</b>
The program must also be linked with
Slurm's implementation of the PMI library so that tasks can communicate
host and port information at startup. (The system administrator can add
host and port information at startup. (The system administrator can add
these option to the mpicc and mpif77 commands directly, so the user will not
these option to the mpicc and mpif77 commands directly, so the user will not
need to bother).
<b>Do not use Slurm's MVAPICH plugin for MVAPICH2.</b>
need to bother).
<pre>
<pre>
$ mpicc -L<path_to_slurm_lib> -lpmi ...
$ mpicc -L<path_to_slurm_lib> -lpmi ...
$ srun -n16 --mpi=none a.out
$ srun -n16 --mpi=none a.out
</pre>
</pre>
<hr size=4 width="100%">
<hr size=4 width="100%">
...
@@ -508,6 +526,6 @@ $ srun -N4 -n16 a.out
...
@@ -508,6 +526,6 @@ $ srun -N4 -n16 a.out
<hr size=4 width="100%">
<hr size=4 width="100%">
<p style="text-align:center;">Last modified
13 Sept
ember 2013</p>
<p style="text-align:center;">Last modified
28 Nov
ember 2013</p>
<!--#include virtual="footer.txt"-->
<!--#include virtual="footer.txt"-->
This diff is collapsed.
Click to expand it.
doc/html/team.shtml
+
1
−
0
View file @
118eb95e
...
@@ -57,6 +57,7 @@ Lead Slurm developers are:
...
@@ -57,6 +57,7 @@ Lead Slurm developers are:
<li>Hongjia Cao (National University of Defense Technology, China)</li>
<li>Hongjia Cao (National University of Defense Technology, China)</li>
<li>Jimmy Cao (Greenplum/EMC)</li>
<li>Jimmy Cao (Greenplum/EMC)</li>
<li>Ralph Castain (Intel, Greenplum/EMC, Los Alamos National Laboratory)</li>
<li>Ralph Castain (Intel, Greenplum/EMC, Los Alamos National Laboratory)</li>
<li>Sourav Chakraborty (The Ohio State University)</li>
<li>François Chevallier (CEA)</li>
<li>François Chevallier (CEA)</li>
<li>Daniel Christians (HP)</li>
<li>Daniel Christians (HP)</li>
<li>Brian Christiansen (SchedMD)</li>
<li>Brian Christiansen (SchedMD)</li>
...
...
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment