AI Glossary: Letter "G"

A Generative Adversarial Network (GAN) is a generative AI architecture consisting of two neural networks: a Generator (which creates fake data) and a Discriminator (which evaluates if the data is real or fake). The networks train in competition, forcing the generator to produce high-fidelity data.

A Gating Mechanism is a structural design in neural networks that controls the flow of information through internal pathways using sigmoid-activated scalar multipliers.

GELU (Gaussian Error Linear Unit) is a smooth activation function that scales input values by the cumulative distribution function of the standard normal distribution, commonly used in BERT and modern Transformers.

Gemini is a family of highly capable, natively multimodal AI models developed by Google. Designed from the ground up to process and combine different modalities of information (including text, code, audio, image, and video) seamlessly.

Generalization is a machine learning model's ability to make accurate predictions on new, unseen test data that was not present in the dataset used to train the network.

Generative AI refers to algorithms and models designed to generate new, original content, including text, images, music, code, or video. Popular architectures like Transformers, GANs, and Diffusion models serve as the engines powering generative AI platforms.

Generative Engine Optimization (GEO) is the modern marketing and search optimization practice of structuring website content so it is successfully retrieved, cited, and recommended by AI search engines and LLM answer systems.

Generative Pre-training is the initial phase of training a Large Language Model on massive, unlabeled text datasets where the model learns token relationships by predicting the next word in sequence.

GGUF (GPT-Generated Unified Format) is a file format designed for storing models for inference with llama.cpp. It is optimized to support fast on-device loading and quantization.

GPT (Generative Pre-trained Transformer) is a decoder-only autoregressive transformer architecture developed by OpenAI. It was pre-trained on massive text datasets to predict next words, pioneering the modern conversational AI era.

GPT-4 is a state-of-the-art multimodal Large Language Model developed by OpenAI, trained on both text and visual inputs to perform complex reasoning, coding, and logical operations.

GPT-ese (or AI-speak) is a colloquial term for the specific stylistic, overly polite, repetitive, or cliché-ridden writing style characteristic of outputs generated by early Large Language Models without custom alignment.

A Graphics Processing Unit (GPU) is a specialized electronic circuit designed to rapidly manipulate and alter memory. Because training neural networks involves massive matrix multiplication, the parallel processing power of GPUs is critical for modern AI workloads.

Gradient Descent is an optimization algorithm used to minimize a model's loss function during training. It iteratively calculates the slope (gradient) of the error surface and updates model parameters (weights) in the direction of the steepest descent.

A Graph Neural Network (GNN) is a class of artificial neural network designed to process data represented as graphs (consisting of nodes and edges), extracting features through message-passing neighborhoods.

Graph RAG (Graph Retrieval-Augmented Generation) is an advanced retrieval technique that couples vector similarity search with structured Knowledge Graphs. It extracts entities and relationships from documents, building a network to answer complex, global queries.

Greedy Decoding is a sequence generation method where the model always selects the single token with the highest predicted probability at each step during output text generation.

Grounding is the process of anchoring an AI model's generated outputs to verifiable real-world facts, external files, or structured databases. It keeps model predictions factual, grounded, and traceably accurate.

Grouped-Query Attention (GQA) is an attention query layout grouping query heads to share a single Key and Value head, reducing the memory footprint of the KV cache.

Group Relative Policy Optimization (GRPO) is a parameter-efficient reinforcement learning algorithm used to align language models. Rather than relying on a separate reward model, GRPO evaluates model responses relative to a group of generated answers, reducing GPU overhead.

Guardrails refer to validation layers placed around AI models to intercept inputs (prompts) and outputs (completions). They ensure safety policies, structure schemas, and prevent toxic leakage or jailbreaks.