Start
knowledge-distillation-a-survey
knowledge-distillation-a-survey - Skill Dossier
knowledge-distillation-a-survey

knowledge-distillation-a-survey

Choose what kind of knowledge to transfer between teacher and student models: response, feature, or relational, and decide among offline, online, self, or cross-modal distillation schemes. Best for distillation strategy selection, capacity-gap diagnosis, and transfer planning. Activate on "knowledge distillation", "teacher-student", "soft labels", "feature distillation", "online distillation", or "cross-modal transfer". NOT for generic compression checklists or unrelated training work.

Uncategorized

Allowed Tools

ReadWriteEditGlobGrep

Share this skill

Skills use the open SKILL.md standard — the same file works across all platforms.

Install all 463+ skills as a plugin
claude plugin marketplace add curiositech/windags-skills claude plugin install windags-skills

Claude activates knowledge-distillation-a-survey automatically when your task matches its description.

View on GitHub
"Use knowledge-distillation-a-survey to help me build a feature system"
"I need expert help with choose what kind of knowledge to transfer between ..."