Mixture of Experts
MoE
A Mixture of Experts model contains several specialised parts and sends each task to only the parts most suited to it.
Explained simply
A Mixture of Experts model contains several specialised parts and sends each task to only the parts most suited to it.
At a glance
- Category
- Models
- Difficulty
- Advanced
- Introduced
- 1991
Real example
A model sends a coding question to parts specialised in code instead of using every part of the model.
Why it matters
It gives you a clear way to understand where this idea fits in AI and how it affects the tools you use.
Timeline
The ideas behind Mixture of Experts begin developing.
Mixture of Experts becomes a recognised term or technique.
Research and practical applications increase.
Mixture of Experts becomes connected to newer AI systems and products.
Mixture of Experts remains relevant in the models area of AI.
Learn next
Continue with these connected terms:
Simple infographic
A quick visual way to understand Mixture of Experts.
Was this helpful?
Your feedback helps improve this explanation.