Alpaca's cheap distillation of ChatGPT (2023)
Stanford researchers fine-tuned Meta's LLaMA on 52,000 self-instruct examples for under $600, reproducing much of ChatGPT's behavior in an open-weights model.
Sparked a wave of open instruction-tuning; the Alpaca approach was copied across the community within weeks.
Established that closed-model behavior could be captured cheaply and openly, accelerating the open-weights ecosystem.
JEV-27B repeats the pattern one step later: reproducing a closed decision model's outputs with a small, cheaply trained block instead of a full chat model.
