Improve Documentation for Pytorch Parallel training

  • removes docu for Horovod since it is more or less a dead framework, closes #654 (closed)
  • improves docu for Pytorch native multi GPU methods
  • adds example how to set up environment for Pytorch DDP
  • adds example to use torchrun
Edited by Sebastian Döbel

Merge request reports

Loading