# What is Learning Rate? Definition & Technical Mechanics

> **Source:** [SPIDITS AI AI Glossary](https://spidits.com/ai-glossary)  
> **Category:** Mathematical Foundations  
> **Canonical Citation:** [https://spidits.com/ai-glossary/learning-rate](https://spidits.com/ai-glossary/learning-rate)

## Definition
Learning Rate is a fundamental tuning hyperparameter in gradient descent optimizers that determines the mathematical step size taken toward the global minimum of the loss function during model training.

## Architectural Mechanics & Deep Dive
Learning rate is a fundamental training hyperparameter that defines the step size taken by the optimization algorithm (like gradient descent) at each iteration while updating model parameters. If the learning rate is too high, the model may overshoot the minimum and fail to converge; if it is too low, training will be computationally slow and risks getting trapped in suboptimal local minima.

## Industry Applications & Real-World Use Cases
Gradient descent optimization, hyperparameter tuning runs, and neural training configuration.

## Frequently Asked Questions

### What happens if the learning rate is set too high?
The optimizer can overshoot the global minimum, causing the training loss to diverge or fluctuate wildly instead of converging.

### What happens if the learning rate is set too low?
The parameter updates will be extremely small, making the training process slow and potentially getting stuck in local minima.

## Related Terminology
- [gradient-descent](https://spidits.com/ai-glossary/gradient-descent)
- [adam-optimizer](https://spidits.com/ai-glossary/adam-optimizer)
- [hyperparameter](https://spidits.com/ai-glossary/hyperparameter)
- [learning-rate-decay](https://spidits.com/ai-glossary/learning-rate-decay)

---
*From the SPIDITS AI Knowledge Base (336+ terms indexed). Explore full technical definitions: [https://spidits.com/ai-glossary](https://spidits.com/ai-glossary)*