state dict as a PyTorch DCP. After conversion, FSDP training can populate each rank's shard from DCP in parallel — sidestepping the rank-0-read + per-tensor-NCCL-broadcast pattern that hangs at 405B ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results