Open-Foundation-Models

non-profit

AI & ML interests

None defined yet.

Recent Activity

Taoer authored a paper 21 days ago

Mixture-of-Depths Attention

Taoer authored a paper 21 days ago

GatePro: Parameter-Free Expert Selection Optimization for Mixture-of-Experts Models

Taoer authored a paper 6 months ago

Virtual Width Networks

View all activity

Open-Foundation-Models 's models 2

Open-Foundation-Models/PolyNorm_1B

Text Generation • Updated Apr 8, 2025 • 15

Open-Foundation-Models/PolyReLU_1B

Text Generation • Updated Apr 8, 2025 • 11