Skip to content
Snippets Groups Projects
Commit f65f2791 authored by Veronika Scholz's avatar Veronika Scholz
Browse files

Fix formatting

parent 8c0a760e
No related branches found
No related tags found
6 merge requests!398Update data_analytics_with_python.md. Fixed spelling and wording. All issues...,!392Merge preview into contrib guide for browser users,!368Update experiments.md,!356Merge preview in main,!355Merge preview in main,!341Updated TensorFlow and Horovod in distributed_training.md
...@@ -224,12 +224,12 @@ module load Horovod/0.19.5-fosscuda-2019b-TensorFlow-2.2.0-Python-3.7.4 #Lo ...@@ -224,12 +224,12 @@ module load Horovod/0.19.5-fosscuda-2019b-TensorFlow-2.2.0-Python-3.7.4 #Lo
``` ```
Or if you want to use Horovod on the Alpha partition you can load it with the dependencies: Or if you want to use Horovod on the Alpha partition you can load it with the dependencies:
```bash ```bash
module spider Horovod #Check available modules and dependencies module spider Horovod #Check available modules and dependencies
module load modenv/hiera GCC/10.2.0 CUDA/11.1.1 OpenMPI/4.0.5 Horovod/0.21.1-TensorFlow-2.4.1 module load modenv/hiera GCC/10.2.0 CUDA/11.1.1 OpenMPI/4.0.5 Horovod/0.21.1-TensorFlow-2.4.1
``` ```
#### Horovod installation #### Horovod installation
However if it is necessary to use another version of Horovod it is possible to install it manually. However if it is necessary to use another version of Horovod it is possible to install it manually.
...@@ -282,7 +282,8 @@ HOROVOD_GPU_OPERATIONS=NCCL HOROVOD_WITH_TENSORFLOW=1 pip install --no-cache-dir ...@@ -282,7 +282,8 @@ HOROVOD_GPU_OPERATIONS=NCCL HOROVOD_WITH_TENSORFLOW=1 pip install --no-cache-dir
horovodrun --check-build horovodrun --check-build
``` ```
If you want to use OpenMPI then specify `HOROVOD_GPU_ALLREDUCE=MPI`. To have better performance it is recommended to use NCCL instead of OpenMPI. If you want to use OpenMPI then specify `HOROVOD_GPU_ALLREDUCE=MPI`.
To have better performance it is recommended to use NCCL instead of OpenMPI.
##### Verify that Horovod works ##### Verify that Horovod works
...@@ -296,7 +297,6 @@ hvd.rank() ...@@ -296,7 +297,6 @@ hvd.rank()
print('Hello from:', hvd.rank()) print('Hello from:', hvd.rank())
``` ```
#### Example #### Example
Horovod is easy to use Horovod is easy to use
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment