#Mixture-of-Experts

Hunyuan-A13B Identifys New Standard in Open Source Language Models with Efficient Structure

Hunyuan-A13B, developed by Tencent’s Mixture-of-Experts architecture, reduces cost by activating only 13 billion parameters while offering powerful pe