add common.pt
26dd337 verified - 1.96 kB add __3_1.distcp
.metadata Detected Pickle imports (13)
- "torch.distributed.checkpoint.filesystem._StorageInfo",
- "torch.distributed.checkpoint.metadata.TensorStorageMetadata",
- "torch.distributed.checkpoint.metadata.MetadataIndex",
- "torch.distributed.checkpoint.metadata.BytesStorageMetadata",
- "torch.bfloat16",
- "torch.distributed.checkpoint.metadata.ChunkStorageMetadata",
- "torch.distributed.checkpoint.metadata.TensorProperties",
- "megatron.core.dist_checkpointing.strategies.torch.MCoreMetadata",
- "torch.distributed.checkpoint.metadata.StorageMeta",
- "torch.float32",
- "torch.distributed.checkpoint.metadata._MEM_FORMAT_ENCODING",
- "torch.Size",
- "torch.serialization._get_layout"
How to fix it?
562 kB add .metadata - 1.5 kB add README
- 14.3 GB add __0_0.distcp
- 14.3 GB add __0_1.distcp
- 14.3 GB add __1_0.distcp
- 14.3 GB add __1_1.distcp
- 14.3 GB add __2_0.distcp
- 14.3 GB add __2_1.distcp
- 14.3 GB add __3_0.distcp
- 14.3 GB add __3_1.distcp
common.pt Detected Pickle imports (11)
- "collections.OrderedDict",
- "argparse.Namespace",
- "signal.Signals",
- "megatron.core.transformer.enums.AttnBackend",
- "torch.FloatStorage",
- "torch.float32",
- "torch._utils._rebuild_tensor_v2",
- "torch.bfloat16",
- "torch.optim.adamw.AdamW",
- "transformer_engine.pytorch.optimizers.fused_adam.FusedAdam",
- "megatron.core.enums.ModelType"
How to fix it?
128 kB add common.pt - 119 Bytes add metadata.json
