Definition
Hyperparameter
A Hyperparameter is a configuration variable whose value is set before the machine learning training process begins. Unlike standard parameters (weights and biases) which are learned automatically during training, hyperparameters control the learning behavior itself.
Frequently Asked Questions
What are some common hyperparameters?▼
Learning rate, batch size, number of epochs, activation function type, and dropout rate.
What is hyperparameter tuning?▼
The process of searching for the optimal combination of hyperparameters (using grid search, random search, or Bayesian optimization) to maximize model accuracy.
Quick Facts
- CategoryModel Training
- Key ApplicationModel optimization, tuning runs, and training configuration
Coverage Trend12 Weeks
12w agoToday
Related AI Terms
Hyperparameter Media Coverage & Intelligence
AWS ML BlogJun 2, 2026
The art and science of hyperparameter optimization on Amazon Nova Forge
Fine-tuning for domain-specific tasks means improving performance in one area without degrading the model's general capabilities, and getting that balance right