open-lm-engine/gdn-7b
7B • Updated • 1
M2RNN
Note that the 7B models are MoE with 1.1B active parameters and 400M models are dense models
-
-
open-lm-engine/m2rnn-7b
7B • Updated • 6 • 2 -
open-lm-engine/transformer-7b
7B • Updated • 1 • 1 -
open-lm-engine/hybrid-gdn-7b
7B • Updated • 1 -
open-lm-engine/hybrid-m2rnn-7b
7B • Updated • 1 • 1 -
open-lm-engine/hybrid-gdn-m2rnn-1l-7b
7B • Updated • 1 -
open-lm-engine/hybrid-gdn-m2rnn-5l-7b
7B • Updated • 1 -
open-lm-engine/gdn-400m
0.4B • Updated • 3 • 1 -
open-lm-engine/m2rnn-400m
0.4B • Updated • 9 • 1 -
open-lm-engine/transformer-400m
0.4B • Updated • 1 -
open-lm-engine/hybrid-gdn-400m
0.4B • Updated • 3 • 2 -
open-lm-engine/hybrid-m2rnn-400m
0.4B • Updated • 1 • 1 -
open-lm-engine/hybrid-gdn-m2rnn-1l-400m
0.4B • Updated • 1 -
open-lm-engine/hybrid-gdn-m2rnn-3l-400m
0.4B • Updated • 1 • 1