https://cluster-site.onrender.com/tags/knowledgedistillation/ Recent content in Knowledgedistillation on Tenu Tech Brief Hugo -- 0.146.0 en-us Tue, 24 Feb 2026 06:04:08 +0000 https://cluster-site.onrender.com/posts/kd4mt-a-survey-of-knowledge-distillation-for-machine-translation/ Thu, 19 Feb 2026 05:00:00 +0000 https://cluster-site.onrender.com/posts/kd4mt-a-survey-of-knowledge-distillation-for-machine-translation/ • KD used for compression and knowledge transfer in MT, shaping supervision and translation quality. • Survey covers 105 papers up to Oct 2025, providing comprehensive landscape of https://cluster-site.onrender.com/posts/protecting-language-models-against-unauthorized-distillation-through-trace-rewriting/ Wed, 18 Feb 2026 05:00:00 +0000 https://cluster-site.onrender.com/posts/protecting-language-models-against-unauthorized-distillation-through-trace-rewriting/ • Uses trace rewriting to deter unauthorized knowledge distillation from large language models. • Introduces anti-distillation techniques that degrade training usefulness while kee