SKILL-KD: Contrastive Skill Distillation for LLM Agents

Excerpt

arXiv:2607.28048v3 Announce Type: replace Abstract: Skill-based prompting has become a practical mechanism for improving LLM agents, yet existing methods often treat skills as summaries of the agent's own experience or of successful demonstrations. This creates a mismatch for weaker student agents. A failed trajectory may not reveal the missing knowledge or strategy, while a teacher trajectory may be too implicit to internalize. We propose SKILL-KD, a contrastive skill distillation framework tha