Definition
Inductive Bias
Inductive Bias refers to the assumptions a machine learning algorithm uses to predict outputs for unseen inputs. It prioritizes specific solutions based on the structural design of the model.
Frequently Asked Questions
What is the inductive bias of a CNN?▼
Spatial locality (pixels close together are related) and translation invariance (objects are the same regardless of where they are in the frame).
Why do Transformers have less inductive bias than CNNs?▼
Because their attention mechanism models relationships between all tokens globally, requiring more training data to learn spatial arrangements.
Quick Facts
- CategoryMathematical Foundations
- Key ApplicationNeural network design, algorithm comparison, and generalization audits.
Coverage Trend12 Weeks
12w agoToday
Related AI Terms
Inductive Bias Media Coverage & Intelligence
arXiv AIJun 19, 2026
ITNet: A Learnable Integral Transform That Subsumes Convolution, Attention, and Recurrence
Convolutional networks, recurrent networks, and transformers each encode different inductive biases -- locality, sequential memory, and content-dependent pairwi