TorchDynamo Update 9: Making DDP Work with TorchDynamo

[Chillee]

There’s a lot undetermined here, but in principle, there’s no reason you can’t trace through the hooks, and have the collectives inserted at the right locations in your graph.