What is Dataset Distillation? - AI Encyclopedia
Dataset distillation, also known as dataset compression, is a technique designed to extract key information from large datasets and build a smaller dataset. This...
Dataset distillation, also known as dataset compression, is a technique designed to extract key information from large datasets and build a smaller dataset. This...
The Scaling Law describes how model performance changes with model size (such as the number of parameters), training dataset size, and computational resources used for training. It reflects the relationship between model performance and these factors...
Connectionism, also known as link theory, is a theoretical framework in cognitive science and artificial intelligence that advocates explaining cognitive processes by simulating the interconnections between neurons in the brain. This theory posits that...
The objective function is a core concept in mathematical optimization problems; it represents the functional relationship between the objective and the influencing factors. Simply put, the objective function is the function you are trying to calculate or optimize to achieve...
Slow Perception is a novel visual perception concept proposed by the Step Multimodal team. Through a progressive decomposition and flow approach, it allows models to perceive complex geometric shapes with greater finer detail, much like humans. In experiments,...
Judge models are auxiliary models used to evaluate the quality of the output of other models. They act as "referees," evaluating and scoring the output of Large Language Models (LLMs). The models are evaluated based on the input question and the...
Agentic RAG is a method that combines AI agents and retrieval augmentation generation (RAG) systems. It revolutionizes question-answering by introducing an agent framework. This differs from methods that rely solely on large models...
Forward chaining is a method in the field of artificial intelligence that uses inference engines for automated reasoning. It's a data-driven reasoning strategy that starts with known facts and derives new information by applying a series of rules...
Discriminative models are an important class of models in machine learning, primarily used for classification and regression tasks. Their core objective is to learn the mapping relationship between input variable x and output variable y, i.e., the conditional probability distribution P(y|x). (This is in contrast to generative models...)
Native Sparse Attention (NSA) is a novel sparse attention mechanism proposed by DeepSeek, which improves the efficiency of long text modeling through algorithmic innovation and hardware optimization. Its core lies in a dynamic hierarchical sparse strategy, combined with coarse-grained...
Chain-of-Draft (CoD) is a new AI reasoning paradigm proposed by Zoom's research team. It improves reasoning efficiency and saves costs by mimicking the concise thought process of humans. This approach is inspired by the human reliance on drafts or...
The Model Context Protocol (MCP) is an open protocol that enables seamless communication between large language models (LLMs) and external tools and data sources. It achieves interfacing with various data sources through a unified protocol...
Vibe Coding is a new programming paradigm introduced by Andrej Karpathy, co-founder of OpenAI. Based on artificial intelligence, particularly Large Language Models (LLMs), developers describe requirements using natural language, and AI...
ANP (Agent Network Protocol) is an open-source intelligent agent communication protocol, becoming the HTTP of the intelligent agent internet era, building an open, secure, and efficient collaborative network for billions of intelligent agents. It breaks down data silos...
The Model Context Protocol (MCP) is an open protocol introduced by Anthropic that standardizes communication between large language models (LLMs) and external data sources and tools. By providing a unified interface, it enables LLMs to be flexible...
The Harmony Agent Framework (HMAF) is a core artificial intelligence framework developed by Huawei for its self-developed HarmonyOS operating system. Its purpose is to build a system with...
Context engineering refers to building a dynamic system that provides the right information and tools in the correct format, enabling the Large Language Model (LLM) to perform its tasks appropriately. It is a systematic approach to ensure that the LLM obtains the necessary information and tools to perform its tasks...
Agent Guidance Language (AGL) is a structured natural language programming method that borrows from Standard Operating Procedures (SOPs) to enable business experts to write "executable instructions" for agents using natural language...
AP2 (Agentic Payments Protocol) is an open protocol that provides users with a secure, scalable, and payment-agnostic framework to enable smart agent payments across platforms for users, merchants, and payment providers.
Agentic Context Engineering (ACE) is an innovative framework proposed by researchers at Stanford University, SambaNova Systems, and the University of California, Berkeley. It works by dynamically optimizing input information (i.e., "context") to...
Nested Learning is a new machine learning paradigm introduced by Google that addresses the "catastrophic forgetting" problem faced by traditional large language models during continuous learning. Nested Learning integrates complex machine learning models...