# What is LPU? Definition & Technical Mechanics

> **Source:** [SPIDITS AI AI Glossary](https://spidits.com/ai-glossary)  
> **Category:** Hardware & Infrastructure  
> **Canonical Citation:** [https://spidits.com/ai-glossary/lpu](https://spidits.com/ai-glossary/lpu)

## Definition
A Language Processing Unit (LPU) is a specialized hardware accelerator designed specifically for sequential language processing tasks, such as LLM inference. LPUs focus on minimizing memory bandwidth bottlenecks to enable extremely high token generation speeds.

## Architectural Mechanics & Deep Dive
Language Processing Units (LPUs) are custom hardware accelerators designed specifically to minimize memory access bottlenecks during sequential token generation. Unlike general-purpose GPUs that excel at massive parallel math, LPUs use synchronous compiler scheduling and SRAM storage to feed model weights to processing cores instantly, allowing interactive chat APIs to run at hundreds of tokens per second.

## Industry Applications & Real-World Use Cases
Ultra-low latency chat APIs, real-time agent execution, and interactive translation

## Frequently Asked Questions

### Who created the LPU?
Groq developed the LPU architecture using a software-defined Tensor Streaming Processor.

### Why is an LPU faster than a GPU for inference?
LPUs use static compiler scheduling to fetch weights instantly, bypassing the memory access latency common in GPUs.

## Related Terminology
- [gpu](https://spidits.com/ai-glossary/gpu)
- [tpu](https://spidits.com/ai-glossary/tpu)
- [inference](https://spidits.com/ai-glossary/inference)

---
*From the SPIDITS AI Knowledge Base (300+ terms indexed). Explore full technical definitions: [https://spidits.com/ai-glossary](https://spidits.com/ai-glossary)*