Python torch.distributed Module

This page shows the popular functions and classes defined in the torch.distributed module. The items are ordered by their popularity in 40,000 open source Python projects. If you can not find a good example below, you can try the search function to search modules.

• 1. init_process_group()    
  Used in 186 projects
• 2. get_world_size()    
  Used in 150 projects
• 3. all_reduce()    
  Used in 128 projects
• 4. get_rank()    
  Used in 124 projects
• 5. barrier()    
  Used in 78 projects
• 6. is_initialized()    
  Used in 70 projects
• 7. is_available()    
  Used in 66 projects
• 8. broadcast()    
  Used in 58 projects
• 9. reduce()    
  Used in 46 projects
• 10. all_gather()    
  Used in 45 projects
• 11. destroy_process_group()    
  Used in 21 projects
• 12. new_group()    
  Used in 16 projects
• 13. get_backend()    
  Used in 14 projects
• 14. _backend()    
  Used in 10 projects
• 15. gather()    
  Used in 6 projects
• 16. _clear_group_cache()    
  Used in 6 projects
• 17. recv()    
  Used in 5 projects