ZO2: Scalable Zeroth-Order Fine-Tuning for Extremely Large Language Models with Limited GPU Memory
Paper
•
2503.12668
•
Published
•
1
Liangyu Wang
ly4096
·
AI & ML interests
Efficient reinforcement learning (RL) for LLMs reasoning
Distributed training and inference of LLMs
Efficient algorithm and infrastructure design for LLMs
Organizations
upvoted
a
paper
9 months ago