Torch.compile() + FSDP - Dec 8th

youkaichao December 9, 2023, 12:28pm 2

It’s great to see a summarization blog like this!

In additon, are there any similar blogs for torch.compile support on DataParallel and DistributedDataParallel?

Topic		Replies	Views
TorchDynamo Update 11: Making FSDP and Dynamo Work Together compiler	5	4923	December 27, 2023
Meta PyTorch Team 2024 H2 Roadmaps	20	24131	February 19, 2025
Call for backward compatability to enable users to understand and adapt to pytorch compiler compiler	2	725	November 18, 2023
Higher Order Operators, 2023/10	2	3148	March 25, 2025
PyTorch 2.1: automatic dynamic shape compilation, torch.distributed.checkpoint, torch.compile + NumPy, torch.export prototype, and more! Release Announcements	0	1063	October 6, 2023