- Python multiprocessing docs (pay attention to
forkvsspawn!) - PyTorch Distributed tutorial
- Collective communication protocols in NCCL
- There's a ton of links on the slides, please check the PDF.
week05_data_parallel
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
parent directory.. | ||||