Jen Wei's picture

Open to Work

Jen Wei

bird-of-paradise

·

https://birdofparadise.ai/

AI & ML interests

Training Dynamics & Model Systems | RL & Scaling

Recent Activity

published an article 25 days ago

DeepSeek Engram × OLMo-core: Distributed Implementation

published an article 2 months ago

The Three Horsemen of Numerical Divergence in Hybrid Models

liked a model 2 months ago

allenai/Olmo-Hybrid-Instruct-SFT-7B

View all activity

Organizations

Articles 9

Article

1

DeepSeek Engram × OLMo-core: Distributed Implementation

Article

1

The Three Horsemen of Numerical Divergence in Hybrid Models

View all Articles

spaces 2

Post Training Techniques Guide

A visual guide to post-training techniques for LLMs

ReTool Implementation

Enhance LLMs with strategic tool use for math problems

models 3

bird-of-paradise/Llama-Hopper-Reasoning-v1

Reinforcement Learning • Updated Feb 6

bird-of-paradise/deepseek-mla

Text Generation • Updated Feb 27, 2025 • 19

bird-of-paradise/deepseek-moe

Text Generation • Updated Feb 27, 2025 • 5

datasets 4

bird-of-paradise/transformer-from-scratch-tutorial

Updated Jan 12 • 97 • 41

bird-of-paradise/muon-tutorial

Viewer • Updated Jan 12 • 3 • 435 • 13

bird-of-paradise/muon-distributed-reproducibility

Updated Nov 30, 2025 • 39 • 2

bird-of-paradise/muon-distributed

Updated Nov 8, 2025 • 62 • 1