diff --git a/doc/html/ibm-pe.shtml b/doc/html/ibm-pe.shtml index 5c59d2d78f703c7995c96cd501dcf3ad7dd7418b..7604aeb3b0ceb48d41663549bccb04a6bfcbd553 100644 --- a/doc/html/ibm-pe.shtml +++ b/doc/html/ibm-pe.shtml @@ -422,27 +422,22 @@ For example:</p> %_with_libnrt "/opt/ibmhpc/pecurrent/base/intel/lib64" </pre> -<p>The poe command interacts with SLURM by loading a SLURM library providing -a variety of functions for its use. You must specify the location of that -library and note that SLURM is the workload manager in the file named -"/etc/poe.limits". -The library name is "libpermapi.so" and it is in installed with the other SLURM -libraries in the subdirectory "lib/slurm". A sample "/etc/poe.limits" file is -shown below. You will need to modify the value of MP_PE_RMLIB to match SLURM's -installation location on your system.<br> -<b>NOTE:</b> The poe command is loading and using the libpermapi.so library -initially from the /usr/lib64 directory. It later reads the /etc/poe.limits -file and loads the correct library. In order for poe to work with SLURM, it -needs to use the "libpermapi.so" generated by SLURM for all of its functions. -Until poe is modified to only load the correct library, it is necessary for -the file /usr/lib64/libpermapi.so to contain SLURM's library or a link to it.</p> -<pre> -# -# Sample /etc/poe.limits -# Modify the path below as appropriate -# -MP_PE_RMLIB=/usr/local/lib/slurm/libpermapi.so -</pre> +<p><b>IMPORTANT:</b>The poe command interacts with SLURM by loading a + SLURM library providing a variety of functions for its use. The + library name is <i>"libpermapi.so"</i> and it is in installed with the + other SLURM libraries in the subdirectory "lib/slurm". You must + modify the link of /usr/lib64/libpermapi.so to point to the location + of the slurm version of this library.</p> +<p>Modifying the "/etc/poe.limits" file is <b>not</b> enough. The poe + command is loading and using the libpermapi.so library initially + from the /usr/lib64 directory. It later reads the /etc/poe.limits + file and loads the library listed there. In order for poe to work + with SLURM, it needs to use the "libpermapi.so" generated by SLURM + for all of its functions. Until poe is modified to only load the + correct library, it is necessary for /usr/lib64/libpermapi.so to + contain SLURM's library or a link to it.</p> +<p>If you are having problems running on more than 32 nodes this is + most likely your issue.</p> <p>Changes to the count of dynmamic switch windows necessitate cold-starting Slurm (without jobs). The procedure is as follows:</p>