NAVIGATION
Definition

Masked Language Modeling

Masked Language Modeling (MLM) is a self-supervised training task where a model learns token context by predicting hidden (masked) words in a sentence using surrounding left and right text tokens.

Frequently Asked Questions

Which famous model uses masked language modeling?

BERT (Bidirectional Encoder Representations from Transformers) uses MLM as its primary pre-training objective.

How does MLM differ from causal language modeling?

MLM is bidirectional (looks at past and future tokens to guess the middle word). Causal modeling is unidirectional (only looks at past tokens to predict the next word).

Quick Facts

  • CategoryNatural Language Processing
  • Key ApplicationEncoder model pre-training, BERT training, and token context representation.

Coverage Trend12 Weeks

12w agoToday

Masked Language Modeling Media Coverage & Intelligence

No Direct Masked Language Modeling News Today

We currently have no direct coverage articles matching "Masked Language Modeling" in the database archive. Explore trending global AI topics below instead.

Trending AI Stories

MIT Tech ReviewJun 19, 2026

A startup claims it broke through a bottleneck that's holding back LLMs

Miami-based AI startup Subquadratic came out of stealth mode last month with a huge claim. It announced that it had solved a mathematical bottleneck that had be

Latent SpaceJun 19, 2026

[AINews] GLM GPT? GLM-5.2 passes vibe check; Z.ai forecasts Open Fable by December

With GLM-5.2 passing everyone's vibe check, the open models story finally becomes a real frontier story.

WiredJun 19, 2026

Meta Quest Promo Codes and Coupons for June 2026

Experience cutting-edge VR and save up to 20% with coupons for the latest games, Meta Quest 3, Ray-Ban AI glasses, and more deals.

SiliconANGLEJun 19, 2026

Fabrix.ai demonstrates production-grade agentic operations at Cisco Live

Artificial intelligence dominated headlines and keynotes at every event I've attended this year, including the recent Cisco Live 2026. Though the thirst for AI has been insatiable for a couple of years, customer feedback at the event showed that the era of AI curiosity has given way to AI urgency. I