← Back
ModelsIntermediate2018

BERT

Bidirectional Encoder Representations from Transformers

BERT is a language model designed to understand the meaning of words by looking at the words before and after them.

Explained simply

BERT is a language model designed to understand the meaning of words by looking at the words before and after them.

1Words around term
2Read both directions
3Understand context
4Meaning

At a glance

Category
Models
Difficulty
Intermediate
Introduced
2018

Real example

A search engine uses BERT to understand that “bank” means a riverbank in a question about fishing.

Why it matters

It gives you a clear way to understand where this idea fits in AI and how it affects the tools you use.

Timeline

Origins

The ideas behind BERT begin developing.

2018

BERT becomes a recognised term or technique.

Wider use

Research and practical applications increase.

Modern AI

BERT becomes connected to newer AI systems and products.

Today

BERT remains relevant in the models area of AI.

Dates for broad concepts may describe the period when the idea emerged or became widely used, rather than one exact invention date.

Learn next

Simple infographic

A quick visual way to understand BERT.

1Words around term
2Read both directions
3Understand context
4Meaning
1 of 6

Was this helpful?

Your feedback helps improve this explanation.