From f65f279147ba245e6f58708267c20c81a03f589c Mon Sep 17 00:00:00 2001 From: Emicia <veronika.scholz@tu-dresden.de> Date: Fri, 1 Oct 2021 08:44:00 +0200 Subject: [PATCH] Fix formatting --- doc.zih.tu-dresden.de/docs/software/distributed_training.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/doc.zih.tu-dresden.de/docs/software/distributed_training.md b/doc.zih.tu-dresden.de/docs/software/distributed_training.md index 4cb32d1da..05c266d9e 100644 --- a/doc.zih.tu-dresden.de/docs/software/distributed_training.md +++ b/doc.zih.tu-dresden.de/docs/software/distributed_training.md @@ -224,12 +224,12 @@ module load Horovod/0.19.5-fosscuda-2019b-TensorFlow-2.2.0-Python-3.7.4 #Lo ``` Or if you want to use Horovod on the Alpha partition you can load it with the dependencies: + ```bash module spider Horovod #Check available modules and dependencies module load modenv/hiera GCC/10.2.0 CUDA/11.1.1 OpenMPI/4.0.5 Horovod/0.21.1-TensorFlow-2.4.1 ``` - #### Horovod installation However if it is necessary to use another version of Horovod it is possible to install it manually. @@ -282,7 +282,8 @@ HOROVOD_GPU_OPERATIONS=NCCL HOROVOD_WITH_TENSORFLOW=1 pip install --no-cache-dir horovodrun --check-build ``` -If you want to use OpenMPI then specify `HOROVOD_GPU_ALLREDUCE=MPI`. To have better performance it is recommended to use NCCL instead of OpenMPI. +If you want to use OpenMPI then specify `HOROVOD_GPU_ALLREDUCE=MPI`. +To have better performance it is recommended to use NCCL instead of OpenMPI. ##### Verify that Horovod works @@ -296,7 +297,6 @@ hvd.rank() print('Hello from:', hvd.rank()) ``` - #### Example Horovod is easy to use -- GitLab