AI Glossary: Letter "L"

A Label is the target output or correct outcome variable associated with a training example in supervised learning (e.g. labeling a picture as a "dog" or marking an email as "spam").

LangChain is an open-source framework designed to simplify the creation of applications using Large Language Models, providing abstractions for chains, prompt templates, memory, and tools.

Latent Space is a multi-dimensional space where raw, complex data (such as images or text) is compressed into mathematical vector representations. In latent space, items that share similar abstract concepts or semantic meanings are mapped closer together.

Layer Normalization is a technique that normalizes the activations of a neural network layer across all features for each single training example, stabilizing gradient updates in sequential models.

Learning Rate is a fundamental tuning hyperparameter in gradient descent optimizers that determines the mathematical step size taken toward the global minimum of the loss function during model training.

Learning Rate Decay is a training hyperparameter setting that gradually decreases the optimizer's learning rate over epochs, allowing the model to make large updates early and fine adjustments later.

Linear Attention is a class of attention mechanisms designed to approximate the standard self-attention operation in linear time complexity relative to sequence length, bypassing the quadratic memory scaling limits of standard Transformers.

Linear Regression is a foundational statistical method and supervised learning algorithm used to model the relationship between a dependent variable and one or more independent variables by fitting a linear equation to observed data.

LLaMA (Large Language Model Meta AI) is a family of state-of-the-art open-weights foundation models released by Meta. LLaMA catalyzed the open-source AI developer ecosystem by offering models that could run locally with high efficiency.

LLaMA-Index is a popular open-source data framework designed to connect external data sources (PDFs, databases, APIs) to Large Language Models. It provides tools for data ingestion, indexing, and retrieval query engine setups.

A Large Language Model (LLM) is a type of artificial intelligence model trained on vast amounts of text data to understand, generate, and manipulate natural language. Built on the Transformer architecture, LLMs use billions of parameters to recognize semantic patterns and reasoning relationships.

LLM Evaluation (LLM Eval) is the process of measuring the accuracy, reasoning quality, safety compliance, and formatting correctness of Large Language Model outputs using benchmarks or judge models.

Logistic Regression is a foundational classification algorithm used to predict the probability of a binary target variable by mapping linear inputs to a sigmoid probability curve.

Loop Engineering is the practice of designing, optimizing, and securing autonomous agent execution loops. In agentic AI, this involves structuring the iteration cycle—such as prompt loops, self-correction runs, and human-in-the-loop triggers—to minimize infinite recursion and maximize successful task execution.

LoRA (Low-Rank Adaptation) is a parameter-efficient fine-tuning (PEFT) technique that freezes the pre-trained model weights and injects trainable rank decomposition matrices into each layer of the Transformer architecture, reducing training VRAM requirements.

A Loss Function is a mathematical algorithm that measures the discrepancy between a model's predicted output and the actual true target value during training. The goal of training is to minimize this loss, adjusting weights based on gradients computed from it.

A Language Processing Unit (LPU) is a specialized hardware accelerator designed specifically for sequential language processing tasks, such as LLM inference. LPUs focus on minimizing memory bandwidth bottlenecks to enable extremely high token generation speeds.

LSTM (Long Short-Term Memory) is a specialized recurrent neural network (RNN) architecture. It introduced gating mechanisms (input, output, and forget gates) to manage memory state, solving the vanishing gradient problem for sequential data.

An LSTM Memory Cell is the core building block of a Long Short-Term Memory network, containing a cell state that acts as a conveyor belt to carry historical information across sequences.