Found 3 bookmarks
Newest
Multi-Teacher On-Policy Distillation: A New Post-Training Primitive | Notion
Multi-Teacher On-Policy Distillation: A New Post-Training Primitive | Notion
How frontier AI labs use multi-teacher on-policy distillation to merge capabilities, recover from RL forgetting, and scale post-training across MiMo-V2-Flash, GLM-5, Nemotron-Cascade 2, and DeepSeek-V4.
·yumoxu.notion.site·
Multi-Teacher On-Policy Distillation: A New Post-Training Primitive | Notion
Supervised Fine-Tuning · Hugging Face
Supervised Fine-Tuning · Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
·huggingface.co·
Supervised Fine-Tuning · Hugging Face