概念导读
DeepSeek R1 Distillation refers to the distillation approach used in the DeepSeek R1 model family, where reasoning capabilities are transferred from a large teacher model to smaller student models. This approach is discussed in the on-policy-distillation-survey as a prominent example of reasoning distillation in practice.
- Related
- References
DeepSeek R1 Distillation
DeepSeek R1 Distillation refers to the distillation approach used in the DeepSeek R1 model family, where reasoning capabilities are transferred from a large teacher model to smaller student models. This approach is discussed in the on-policy-distillation-survey as a prominent example of reasoning distillation in practice.
Related
- on-policy-distillation-survey — Surveys DeepSeek R1's distillation methodology
- reasoning-distillation — Broader paradigm of transferring reasoning abilities
- strong-to-weak-distillation — Strong-to-weak model distillation paradigm
References
- DeepSeek-AI (2025). "DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning."