GetSoloTech/Code-Reasoning
Viewer • Updated • 20k • 161 • 8
How to use zeeshaan-ai/solo-tune-test66 with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("unsloth/qwen3-0.6b-unsloth-bnb-4bit")
model = PeftModel.from_pretrained(base_model, "zeeshaan-ai/solo-tune-test66")| Base Model | Qwen/Qwen3-0.6B |
| Method | LoRA (PEFT) |
| Parameters | 0.6B |
| Epochs | 2 |
| Max Steps | 100 |
| Batch Size | 2 |
| Gradient Accumulation | 4 |
| Learning Rate | 0.0002 |
| LoRA r | 4 |
| LoRA Alpha | 4 |
| Max Sequence Length | 2048 |
| Training Duration | 4m 31s |
Fine-tuned using Solo