What is NSA (Native Sparse Attention)? - AI Encyclopedia
Native Sparse Attention (NSA) is a novel sparse attention mechanism proposed by DeepSeek, which improves the efficiency of long text modeling through algorithmic innovation and hardware optimization. Its core lies in a dynamic hierarchical sparse strategy, combined with coarse-grained...