Improve Documentation for Pytorch Parallel training
- removes docu for Horovod since it is more or less a dead framework, closes #654 (closed)
- improves docu for Pytorch native multi GPU methods
- adds example how to set up environment for Pytorch DDP
- adds example to use
torchrun
Edited by Sebastian Döbel