AI Glossary: Letter "A"

Accuracy is a classification metric measuring the fraction of total predictions that the model got correct, calculated as the sum of correct predictions divided by all predictions.

An Activation Function is a mathematical formula applied to the output of a neural network node to determine whether it should be activated (transmit signal) or not. It introduces non-linear properties to the network, allowing it to learn complex patterns instead of just linear transformations.

Active Learning is a semi-supervised learning framework where a machine learning algorithm queries a human annotator to label only the most informative or uncertain data points, minimizing labeling cost.

Adam (Adaptive Moment Estimation) is an optimization algorithm used for training deep learning models. It combines the advantages of RMSProp and Momentum by calculating adaptive learning rates for each parameter based on estimates of the first and second moments of the gradients.

An Adversarial Attack is a technique that feeds a machine learning model intentionally designed inputs (adversarial examples) to cause it to make a mistake, fail, or hallucinate. In image models, this often involves introducing imperceptible pixel noise that completely alters the classification.

An Agent Framework is a standardized software architecture (such as Microsoft AutoGen, CrewAI, LangChain, or LlamaIndex Workflows) designed to orchestrate autonomous AI agents. It provides reusable primitives for tool execution, persistent memory, multi-agent communication, and state management.

Agent Memory refers to persistent memory architectures—combining short-term context buffers, episodic event logs, and long-term vector storage—that allow autonomous AI agents to retain context, remember past user interactions, and recall tools across multiple execution turns.

Agentic AI refers to artificial intelligence systems designed to act autonomously, make decisions, plan workflows, and execute tasks without constant human intervention. Unlike traditional models that only respond to queries, agentic systems use an agentic loop to perceive environments, reason over goals, use tools, and iterate to achieve outcomes.

Agentic RAG is an advanced retrieval methodology where autonomous agents plan, refine, and execute search queries iteratively to answer complex questions. Unlike static RAG, an agentic loop can evaluate the retrieved content, generate new search steps, and seek additional documents if needed.

Artificial General Intelligence (AGI) represents a theoretical form of AI that possesses the ability to understand, learn, and apply knowledge across any intellectual task at a level equal to or surpassing human capabilities. Unlike narrow AI, AGI is characterized by general reasoning and autonomous adaptability.

An AI Agent is an autonomous entity that perceives its environment through sensors (or inputs) and acts upon that environment using actuators (or tools) to achieve specific goals. An agent relies on a reasoning brain (typically an LLM) to plan and execute multi-step processes.

An AI Code Editor is an integrated development environment (IDE) or workspace plugin augmented with autonomous agentic copilots, codebase-wide AST indexing, and multi-file code editing capabilities.

AI Compute refers to the processing capacity (measured in floating-point operations or FLOPs) required to train and run inference on large-scale neural networks and machine learning models.

An AI Copilot is an interactive assistant integrated directly into workspaces and applications, using Large Language Models to help users write code, draft emails, summarize documents, or execute tasks through natural language commands.

AI Ethics is a multidisciplinary field of study and governance that addresses the moral concerns, social impacts, and legal dilemmas associated with the development and deployment of artificial intelligence systems.

AI Governance refers to the systemic framework of policies, procedures, compliance standards, and organizational structures established to supervise, monitor, and regulate an organization's AI deployment.

AI Infrastructure refers to the hardware compute, vector databases, network fabrics, orchestration layers, and MLOps platforms required to train, evaluate, and serve AI models at scale.

An AI Model is a mathematical algorithm trained on a dataset to perform specific tasks like classification, prediction, or text generation. It represents the saved states of a neural network (the weights and biases) after training, which can be deployed to run inference on new, unseen data.

AI Orchestration is the process of coordinating and managing multiple AI models, autonomous agents, data retrieval pipelines, and database updates to execute complex, end-to-end enterprise workflows.

AI Safety is a field of research focused on ensuring that artificial intelligence systems behave predictably, avoid causing harm, and remain aligned with human interests. It spans technical alignment, risk mitigation, and the study of existential risk from advanced systems.

An AI Search Engine is an information retrieval system that utilizes generative models to synthesize direct answers, summaries, and source citations to queries, rather than just returning a list of links (e.g., Perplexity, Google AI Overviews).

AI Tools encompass software applications, SDKs, APIs, and agentic plugins that leverage artificial intelligence to automate domain-specific workflows like coding, design, writing, and data analysis.

AI Writing refers to the process of using artificial intelligence models, particularly Large Language Models, to automatically draft, edit, rephrase, or optimize written content based on human prompts or guidelines.

An Algorithm is a step-by-step procedure or set of mathematical rules designed to solve a specific problem or perform a calculation. In AI, algorithms determine how a model processes inputs and updates its parameters during learning.

Algorithmic Bias (or AI Bias) occurs when a machine learning model generates systematic and repeatable errors that create unfair outcomes, typically due to prejudices or imbalances present in the training datasets.

Alignment refers to the process of guiding an AI model's behaviors, responses, and values to match human intents, safety principles, and ethical standards. Unaligned models might generate toxic text, assist in harmful activities, or refuse user inputs.

Answer Engine Optimization (AEO) is the process of optimizing web content to be retrieved and displayed as the primary, direct answer by search engine featured snippets and voice assistants (like Siri, Alexa, and Google Assistant).

Anthropic is an AI safety and research company, creators of the Claude LLM family, founded by former OpenAI researchers to build steerable, reliable, and constitutional AI systems.

Artificial Intelligence (AI) is a broad field of computer science dedicated to building systems capable of performing tasks that typically require human cognitive function, such as visual perception, speech recognition, decision-making, and translation.

An Attention Mechanism is a technique in neural networks that mimics cognitive attention, allowing the model to focus on specific parts of the input data when generating an output. It enables models to calculate the contextual relationships between distant elements in a sequence.

An Attention Sink is a phenomenon where autoregressive LLMs focus a massive amount of attention weights on the first few tokens of a sequence, regardless of their semantic meaning. Keeping these tokens in the cache prevents performance collapse in long conversations.

Attention Sinks refer to the empirical phenomenon where autoregressive Transformer models assign disproportionately massive softmax attention scores to initial sequence tokens, using them as numerical anchors for attention allocation during long-context generation.

Auto-GPT is an open-source autonomous agent application that showcases the capabilities of Large Language Models (specifically GPT-4) to run independently to achieve a user-defined goal by chaining thoughts and actions in a continuous loop.

An Autoencoder is a type of unsupervised neural network designed to learn efficient data codings (representations) by training the network to ignore signal noise. It consists of an encoder that compresses the input data, and a decoder that reconstructs the input from the compressed representation.

Autoencoding is an unsupervised learning approach where a neural network is trained to reconstruct its input values through a lower-dimensional bottleneck, learning efficient representations of the data.

An Autonomous Agent is an AI system designed to operate independently to achieve specific, high-level objectives. It constructs its own sub-tasks, plans sequences of actions, invokes external tools, inspects intermediate results, and corrects mistakes without user guidance.

An Autoregressive Model is an AI model that predicts future values in a sequence based on past values. In LLMs, autoregressive generation works by taking the prompt, predicting the next word, appending that word to the prompt, and repeating the process.