Fully Sharded Data Parallel (FSDP2 / ZeRO-3) sharding engine in PyTorch.
-
Updated
Oct 9, 2026 - Python
Fully Sharded Data Parallel (FSDP2 / ZeRO-3) sharding engine in PyTorch.
Compare ZeRO-3-style sharding and FSDP2 with per-rank memory and step-time timelines
To associate your repository with the zero-3 topic, visit your repo's landing page and select "manage topics."