I did not see it on the model card. Congratulations on your progress and the results!
It should be around 48.48B parameters activated per token
Β· Sign up or log in to comment