Kosong - A brand new open-source AI Agent development framework from the Dark Side of the Moon

What is Kosong?

Kosong is a new open-source AI Agent development framework from Moonshot AI, providing developers with lightweight, flexible, and highly scalable underlying support for building next-generation intelligent agent applications. Through its asynchronous tool orchestration engine, it can efficiently schedule multiple tools to execute in parallel, such as simultaneously calling weather APIs, map services, and calendar systems, significantly improving agent response efficiency and task completion rates. Kosong adopts a pluggable design, supporting pluggable chat providers. Developers can freely switch between or mix and match different models, such as Kimi, DeepSeek, and Llama3, without modifying core business logic.

Kosong's main functions

• High-efficiency parallel executionKosong uses an asynchronous tool orchestration engine to schedule multiple tools to run in parallel, such as calling weather APIs, map services, and calendar systems simultaneously, which greatly improves task processing efficiency.
• Support for complex task flowsIt can build complex task flows, such as automatically adjusting schedules based on weather conditions, enabling AI agents to handle more complex user needs.
• Flexible model switchingIt supports pluggable chat providers, allowing developers to freely switch or mix and call different models (such as Kimi, DeepSeek, Llama3, etc.) without modifying the core business logic.

Kosong's technical principles

• Asynchronous tool orchestration engineKosong employs asynchronous programming techniques, enabling efficient scheduling of multiple tools to execute in parallel. Through asynchronous task queues and event-driven mechanisms, the framework can handle multiple API calls or tool execution tasks simultaneously, significantly improving task processing efficiency and response speed.
• Plug-in design and standardized componentsThe framework supports pluggable chat providers and tool modules, encapsulating different models and tool functions through standardized interfaces. This allows developers to flexibly switch between or mix and match multiple AI models without modifying core business logic, enhancing development flexibility and scalability.
• Unified LLM Abstraction LayerKosong has built a unified LLM (Large Language Model) abstraction layer, encapsulating different large models, utility functions, and memory modules into standardized components. This solves the problems of tool fragmentation and interface incompatibility, reduces the integration cost for developers, and simplifies the development of complex systems.
• Modern Python ecosystem supportBuilt on Python 3.13 and above, Kosong fully leverages the asynchronous programming features of modern Python. It is also recommended to use the next-generation package manager uv for installation and dependency management to ensure compatibility with the modern Python ecosystem.
• Out-of-the-box and quick experienceKosong provides complete sample code and a built-in demo agent, allowing developers to quickly get started and running with simple environment variable configuration. This enables developers to get started quickly and focus on developing business logic.

Kosong's project address

• Github repositoryhttps://github.com/MoonshotAI/kosong

Kosong's application scenarios

• Intelligent customer service and automated servicesKosong can build intelligent customer service systems that can achieve efficient problem solving and task processing by asynchronously calling multiple tools (such as user information query, order processing, knowledge base retrieval, etc.), thereby improving user experience and service efficiency.
• Personal Assistant and Schedule ManagementLeveraging its asynchronous tool orchestration capabilities, Kosong can be used to develop personal assistant applications that automatically adjust schedules, remind users of important events, and make intelligent decisions based on real-time data such as weather and traffic conditions.
• Multi-model hybrid developmentKosong supports a plug-in design, allowing developers to mix and match multiple AI models, suitable for scenarios that require the advantages of different models, such as content creation, data analysis, and language translation.
• Enterprise application integrationKosong's standardized components and flexible plug-in mechanism enable it to easily integrate with existing enterprise systems and services, such as ERP and CRM, to achieve intelligent business process automation.
• Education and learning toolsIt can develop intelligent education applications that provide students with personalized learning experiences by accessing knowledge bases, online course resources, and real-time feedback tools.
• Smart Home ControlKosong can connect to and control a variety of smart home devices, enabling automated operation of these devices through voice or text commands, thus enhancing the convenience and comfort of home life.