Which Routing Does Each MoE Model Use? DeepSeek, Qwen, Mixtral, Llama 4, gpt-oss Compared

This comparison of 10 open Mixture-of-Experts models shows routing details varying widely: expert counts range from 8 to 384, top-k from 1 to 8, and 7 of 10 models keep one shared expert. DeepSeek-V3 uses sigmoid scoring with a bias-based noaux_tc balancing method, while DeepSeek-V4-Pro raises routed experts to 384, lowers top-k to 6, switches to sqrtsoftplus, and uses hash routing in its first 3 MoE layers. Llama 4 Maverick and gpt-oss do not publish their gating or balancing methods in config.json.