MoE (Mixture of Experts)
A neural network architecture that selectively activates only a subset of 'expert' subnetworks required to process input tokens out of the model's total parameters, simultaneously securing the massive knowledge capacity of large models and efficient computation speeds.
Detailed explanation
Why it matters in tool selection
MoE models are characterized by being 'faster than dense models of equivalent performance, and smarter than models of equivalent computational cost.' It is an essential architecture to consider when looking to achieve top-tier inference performance while reducing API costs or inference server operation expenses. In particular, the fewer the active parameters relative to the total parameter count, the higher the cost-effectiveness.
What to look for
- Number of active parameters relative to total parameters: A key metric that determines actual inference speed
- VRAM requirements: Even if inference speed is fast, a large total parameter size requires a massive amount of high-end GPUs (such as H100)
- Routing stability: Whether knowledge is learned evenly without overloading specific experts
Key Example
The Mixtral 8x7B model has a total of 46.7B parameters but only activates about 12.9B parameters per token during inference. This allows it to deliver performance comparable to the 70B Llama 2 while being approximately 6 times faster in inference speed.