https://cluster-site.onrender.com/tags/mixture-of-experts/ Recent content in Mixture-of-Experts on Tenu Tech Brief Hugo -- 0.146.0 en-us Tue, 24 Feb 2026 06:06:01 +0000 https://cluster-site.onrender.com/posts/ems-fl-federated-tuning-of-mixture-of-experts-in-satellite-terrestrial-networks-via-expert-driven-model-splitting/ Tue, 24 Feb 2026 05:00:00 +0000 https://cluster-site.onrender.com/posts/ems-fl-federated-tuning-of-mixture-of-experts-in-satellite-terrestrial-networks-via-expert-driven-model-splitting/ • Combines Mixture‑of‑Experts (MoE) with satellite‑terrestrial networks (STN) to overcome data scarcity and compute limits in federated learning. • Introduces EMS‑FL, an expert‑dri https://cluster-site.onrender.com/posts/optimizing-communication-for-mixture-of-experts-training-with-hybrid-expert-parallel/ Mon, 02 Feb 2026 18:43:08 +0000 https://cluster-site.onrender.com/posts/optimizing-communication-for-mixture-of-experts-training-with-hybrid-expert-parallel/ • In LLM training, Expert Parallel (EP) communication for hyperscale mixture-of-experts (MoE) models is challenging. • EP communication is essentially all-to-all, but due to its dy