Transformer
Transformer
A transformer is the neural-network design behind most modern language models. It is especially good at understanding relationships within information.
Explained simply
A transformer is the neural-network design behind most modern language models. It is especially good at understanding relationships within information.
At a glance
- Category
- Models
- Difficulty
- Intermediate
- Introduced
- 2017
Real example
A transformer connects words across a sentence to understand which details relate to each other.
Why it matters
It gives you a clear way to understand where this idea fits in AI and how it affects the tools you use.
Timeline
The ideas behind Transformer begin developing.
Transformer becomes a recognised term or technique.
Research and practical applications increase.
Transformer becomes connected to newer AI systems and products.
Transformer remains relevant in the models area of AI.
Learn next
Continue with these connected terms:
Simple infographic
A quick visual way to understand Transformer.
Was this helpful?
Your feedback helps improve this explanation.