Models

mohammadmahdinouri/modernAlbert-1-init

Fill-Mask • 0.3B • Updated May 30 • 3

mohammadmahdinouri/modernAlbert-3-init

Fill-Mask • Updated Jun 4 • 6

mohammadmahdinouri/modernAlbert-2-init

Fill-Mask • Updated May 30 • 4

mohammadmahdinouri/modernAlbert-4-init

Fill-Mask • Updated Jun 4 • 4

mohammadmahdinouri/modernAlbert-4-distillation-init

0.1B • Updated Aug 6 • 6

mohammadmahdinouri/modernAlbert-distilled-checkpoints

Fill-Mask • Updated Aug 2 • 12

mohammadmahdinouri/modernALBERT-12-4096-init

Fill-Mask • Updated Jul 21 • 6

mohammadmahdinouri/modernALBERT-24-2048-init

Fill-Mask • Updated Jul 21 • 5

mohammadmahdinouri/modernalbert_cp_5500

Fill-Mask • 0.2B • Updated Jul 31 • 5

mohammadmahdinouri/modernalbert_cp_9500

Fill-Mask • 0.2B • Updated Jul 31 • 6

mohammadmahdinouri/modernalbert_cp_12000

Fill-Mask • 0.2B • Updated Aug 2 • 5

mohammadmahdinouri/final_modernalbert_checkpoints

Fill-Mask • 0.1B • Updated Aug 2 • 5

mohammadmahdinouri/modernAlbert-vanilla-checkpoints

Fill-Mask • Updated Aug 4 • 6

mohammadmahdinouri/ModernALBERT-no-adapter-init

95.9M • Updated Aug 4 • 5

mohammadmahdinouri/moderAlbert-vanilla-no-adapter

0.1B • Updated Aug 5 • 6

mohammadmahdinouri/moderAlbert-adapter-distilled

0.1B • Updated Aug 5 • 3

mohammadmahdinouri/moderAlbert-vanilla-adapter

0.1B • Updated Aug 5 • 6

mohammadmahdinouri/modernAlbert-distilled-1T

Updated Aug 11 • 6

mohammadmahdinouri/mnli_checkpoint

Text Classification • 0.1B • Updated Aug 10 • 6

mohammadmahdinouri/modernalbert-70M-baseline

Fill-Mask • 75.6M • Updated Aug 12 • 6

mohammadmahdinouri/modernalbert-70M-wiki

Fill-Mask • 75.6M • Updated Aug 13 • 5

mohammadmahdinouri/mol-baseline

Fill-Mask • 73.3M • Updated Aug 26 • 4

mohammadmahdinouri/moa-init

Fill-Mask • 67.5M • Updated Aug 18 • 3

mohammadmahdinouri/moa-checkpoints

Fill-Mask • Updated Aug 18 • 2

mohammadmahdinouri/moa-adapter-init

Fill-Mask • 61.2M • Updated Aug 18 • 5

mohammadmahdinouri/moa-adapter-checkpoints

Fill-Mask • Updated Aug 19 • 6

mohammadmahdinouri/moa-adapter-30k

Fill-Mask • 61.2M • Updated Aug 20 • 5

mohammadmahdinouri/moa-30k

Fill-Mask • 67.5M • Updated Aug 19 • 4

mohammadmahdinouri/moa-vanilla-init

Fill-Mask • 56.8M • Updated Aug 19 • 3

mohammadmahdinouri/moa-vanilla-checkpoints

Fill-Mask • Updated Aug 19 • 4