Toonflow - An open-source, one-stop AI short drama creation tool

What is Toonflow?

Toonflow is an open-source, one-stop AI short drama creation tool that automatically transforms novels and scripts into structured scripts, intelligent storyboards, character visuals, and animated videos through multi-agent collaboration. It achieves end-to-end AI-automated production from novel to script to storyboard to video. The tool supports cross-platform desktop deployment on Windows, macOS, and Linux, with all data stored locally, helping creators produce visual content in batches at low cost.

Toonflow's main functions

• AI screenwriterMulti-agent collaboration automatically breaks down novels/ideas into scenes, dialogue, and rhythm, outputting a standard script format.
• Intelligent storyboardAutomatically generates precise storyboards, including complete descriptions of shot size, composition, lighting direction, and camera movement.
• Maintaining role consistencyEstablish a database of character appearances to maintain a high degree of consistency between character appearances and costumes/props across scenes and shots.
• AI-powered batch image generationIt deeply integrates mainstream image models such as Nano Banana, GPT Image 2, Keling, Jimeng, and Hailuo, and supports batch generation.
• Video synthesis outputAutomatically completes dubbing, subtitles, and editing; the finished product can be published directly, supporting both portrait (9:16) and landscape (16:9) formats.
• Infinite Canvas WorkbenchUse an infinite canvas-like format to freely arrange scripts, characters, storyboards, materials, and video nodes, supporting parallel production.
• Three-tier Agent Collaboration SystemThe decision-making, execution, and supervision levels collaborate to cover task breakdown, content generation, quality review, and revision feedback.
• Persistent Agent MemoryA cross-session memory system based on local ONNX vector retrieval supports semantic recall and ensures continuity of creation across multiple rounds.
• Programmable Supplier SystemIt supports writing TypeScript vendor logic directly in the settings center and having it take effect immediately, without needing to modify the source code or restart.
• Chapter Event Graph Driven AdaptationAutomatically extracts events from the original chapters and stores them in a structured manner; script adaptations can accurately call the context according to the event map.

Toonflow's technical principles

• Multi-Agent Collaboration ArchitectureToonflow employs a three-layer Agent collaboration system, consisting of a decision-making layer, an execution layer, and a supervision layer. The Director Agent coordinates the overall narrative pacing and task priorities; the Screenwriter Agent is responsible for transforming the novel into a standard script and optimizing dramatic conflict; the Storyboard Agent generates precise storyboard descriptions including shot size, composition, lighting, and camera movement; the Consistency Agent establishes a character appearance database to maintain stable character characteristics across scenes; the Quality Inspection Agent automatically reviews plot logic flaws and character inconsistencies; and the Voice Acting Agent matches character voices and generates multi-character voice synthesis scripts. All Agents collaborate in parallel based on the Vercel AI SDK, communicating in real-time via Socket.IO, simulating the division of labor in a real film production team.
• Persistent memory and context preservationThe system incorporates a cross-session memory system based on local ONNX vector retrieval, using @huggingface/transformers for local embedding inference. This memory system supports short-term message caching, long-term summary compression, and semantic recall, ensuring that character settings, plot development, and style preferences are not lost during multiple rounds of creation, thus enabling continuous narrative across chapters.
• Chapter Event Graph Driven AdaptationTo address the issue of information loss during the adaptation of long novels, Toonflow automatically extracts chapter-level events from the original work and constructs a structured event graph. During script adaptation, the system precisely calls relevant context fragments according to the event graph, rather than feeding the entire text at once. This controls token consumption while maintaining a high degree of fidelity between the adapted script and the original plot.

How to use Toonflow

• Download and installGo to the GitHub Releases page to download the installation package for your system, install it, and then launch the application.
• Configuration ModelConfigure text, image, and video model provider APIs in the settings center.
• Create a projectLog in with the default account (admin / admin123), create a new project and import the original novel or creative text.
• Extracting events: Extract chapter events and automatically construct an event graph of the original work to provide accurate context for subsequent adaptations.
• AI screenwriterEnter ScriptAgent to generate story skeletons, adaptation strategies, and structured scripts, supporting multiple rounds of iterative optimization.
• Storyboard ProductionSwitch to ProductionAgent to organize storyboard nodes in an infinite canvas and generate character and scene assets in batches.
• Video generationThe program performs node-based fine-tuning on the storyboard, generates video clips, automatically completes dubbing, subtitles and editing, and exports the final product.

Toonflow's core advantages

• Full process automationFrom text to finished product, it's a one-stop shop, eliminating the need to switch between multiple tools and increasing creative efficiency by 10 times or more.
• Multi-agent collaborationThe director, screenwriter, storyboarder, consistency engineer, quality inspector, voice actor, and other agents collaborate in parallel, resulting in output quality that significantly surpasses that of a single LLM output.
• Character Anchoring SystemSolve the core problem of "character face-changing" in AI short dramas, and maintain a high degree of consistency in character appearance across scenes.
• Model-independent architectureIt is not bound to any single platform, supports free access to mainstream image/video models, and also supports local deployment of models.
• Data is completely localAll data is stored locally, without passing through any third-party servers, ensuring privacy and security.
• Batch factory efficiencySupports batch conversion of entire novels, automatically plans pacing and density, and allows one person to run the entire production line.

Comparison of similar products from Toonflow

Application scenarios of Toonflow

• Short video content creationQuickly generate AI short dramas adapted for platforms such as Douyin, Kuaishou, Bilibili, and YouTube.
• Experiments with adapting novels into filmsThe goal is to automatically adapt online novels into visual short dramas, thus validating the potential for IP adaptation.
• AI-powered literary adaptation toolsIt provides literary creators with the ability to automatically adapt text into video.
• Script Development and Rapid PrototypingFilm and television teams can quickly generate script prototypes and storyboard previews, reducing the cost of trial and error in the early stages.
• Video footage generationBatch generation of character design sketches, scene concept art, video clips, and other creative materials.