Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
S
Slurm
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Releases
Package registry
Model registry
Operate
Environments
Terraform modules
Monitor
Incidents
Service Desk
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Terms and privacy
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
tud-zih-energy
Slurm
Commits
f1ee159e
Commit
f1ee159e
authored
19 years ago
by
Moe Jette
Browse files
Options
Downloads
Patches
Plain Diff
Minor updates for wiring issues and pre-processing for slurmctld to
access the BGL Bridge API.
parent
29800400
No related branches found
No related tags found
No related merge requests found
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
doc/html/bluegene.html
+14
-31
14 additions, 31 deletions
doc/html/bluegene.html
with
14 additions
and
31 deletions
doc/html/bluegene.html
+
14
−
31
View file @
f1ee159e
...
@@ -292,6 +292,11 @@ full-system bglblock, which is implicitly created).
...
@@ -292,6 +292,11 @@ full-system bglblock, which is implicitly created).
See the smap man page for more information.
See the smap man page for more information.
Note that in addition to the bglblocks defined in blugene.conf, an
Note that in addition to the bglblocks defined in blugene.conf, an
additional block containing all resources is created.
additional block containing all resources is created.
Note that SLURM wiring decisions are based upon the link-cards
being interconnected in a specific fashion.
If your BlueGene system is wired in an unconventional fashion,
modifications to the file
<i>
src/partition_allocator/partition_allocator.c
</i>
may be required.
Make use of the SLURM partition mechanism to control access to these
Make use of the SLURM partition mechanism to control access to these
bglblocks. A sample
<i>
bluegene.conf
</i>
file is shown below.
bglblocks. A sample
<i>
bluegene.conf
</i>
file is shown below.
<pre>
<pre>
...
@@ -345,41 +350,19 @@ Nodes=bgl[001x001]
...
@@ -345,41 +350,19 @@ Nodes=bgl[001x001]
# Nodes=bgl[000x001] Full-system bglblock, implicitly created
# Nodes=bgl[000x001] Full-system bglblock, implicitly created
</pre></p>
</pre></p>
<p>
Two other changes are
required to support SLURM interactions with
<p>
One more thing is
required to support SLURM interactions with
the DB2 database (at least as of the time this was written).
the DB2 database (at least as of the time this was written).
DB2 database access is required by the slurmctld daemon only.
DB2 database access is required by the slurmctld daemon only.
All other SLURM daemons and commands interact with DB2 using
All other SLURM daemons and commands interact with DB2 using
remote procedure calls, which are processed by slurmctld.
remote procedure calls, which are processed by slurmctld.
The
<i>
db2profile
</i>
script must be executed prior to the execution
DB2 access is dependent upon the environment variable
of the slurmctld daemon.
<b>
BRIDGE_CONFIG_FILE
</b>
.
This may be accomplished by executing the script from
Make sure this is set appropriate before initiating the
<i>
/etc/sysconfig/slurm
</i>
, which is automatically executed by
slurmctld daemon.
<i>
/etc/init.d/slurm
</i>
.
If desired, this environment variable and any other logic
The second required file is
<i>
db.properties
</i>
, which should
can be executed through the script
<i>
/etc/sysconfig/slurm
</i>
,
be copied into the SLURM configuration directory with
<i>
slurm.conf
</i>
.
which is automatically executed by
<i>
/etc/init.d/slurm
</i>
Again, this can be accomplished using /etc/sysconfig/slurm.
prior to initiating the SLURM daemons.
</p>
A sample
<i>
/etc/sysconfig/slurm
</i>
file follows:
<pre>
# Sample /etc/sysconfig/slurm file
#
# Execute db2profile to configure DB2 environment variables
# required to access DB2 on BlueGene
if [ -f /bgl/BlueLight/ppcfloor/bglsys/bin/db2profile ]; then
. /bgl/BlueLight/ppcfloor/bglsys/bin/db2profile
fi
# Copy db.profile to slurmctld's working directory (SaveStateLocation
# in slurm.conf, also required to access DB2 on BlueGene
if [ -d /usr/local/admin/slurm ]; then
if [ -f /bgl/BlueLight/ppcfloor/bglsys/bin/db.properties ]; then
rm -f /usr/local/admin/slurm/db.properties
cp --preserve /bgl/BlueLight/ppcfloor/bglsys/bin/db.properties \
/usr/local/admin/slurm/db.properties
fi
fi
</pre></p>
<p>
At some time in the future, we expect SLURM to support
<i>
dynamic
<p>
At some time in the future, we expect SLURM to support
<i>
dynamic
partitioning
</i>
in which Blue Gene job partitions are created and destroyed
partitioning
</i>
in which Blue Gene job partitions are created and destroyed
...
...
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment