# BERT **BERT** (Bidirectional Encoder Representations from Transformers) is Google's encoder-only [[Transformer]] architecture, pre-trained on masked language modelling. It is foundational to text understanding and semantic search, and it drives the prompt-encoding stages inside many image generation pipelines — converting natural language into the embedding vectors that guide diffusion. ^overview