Xiaohongshu open-sources multimodal MoE model dots3-note preview

Xiaohongshu's Dots Model Lab has open-sourced the Dots3-note preview, the first open-source version of the Dots3 series. The model has a total of 280 bytes of parameters and 16 bytes of activation parameters, supports up to 512K of context, and possesses multimodal understanding capabilities including text, vision, and speech. It is optimized for complex reasoning, agent-based processing, and multimodal perception. The model performs comparably to larger models with several times the number of parameters on multiple benchmarks.