Textoon - A tool developed by Alibaba Tongyi Labs for generating 2D cartoon characters from text prompts.

What is Textoon?

Textoon is an innovative project launched by Alibaba Group's Tongyi Lab, the first method to generate 2D cartoon characters in Live2D format based on text prompts. Based on advanced language and visual models, it can generate diverse and interactive 2D characters within one minute. The generated characters support animation effects, are suitable for HTML5 rendering, and can be widely used in film, games, social media, and advertising.

Textoon's main functions

• Text parsingTextoon uses a finely tuned Large Language Model (LLM) to extract detailed information from complex text, such as hairstyle, eye color, and clothing type.
• Controllable appearance generationUsing text-to-image models (such as SDXL), Textoon can generate the appearance of a character based on user input and ensure that the generated result matches the user's description.
• Editing and RepairUsers can edit the generated character, adjusting details or fixing unsatisfactory parts.
• Animation EnhancementTextoon integrates ARKit's facial expression parameters, significantly enhancing the animation expressiveness of characters.
• Multilingual supportTextoon supports both Chinese and English prompts, meeting the language needs of different users.

Textoon's technical principles

• Text parsing and intent understandingTextoon, based on a fine-tuned Large Language Model (LLM), can extract detailed information from complex text descriptions, such as hairstyle, hair color, eye color, and clothing type. Its accurate text parsing capabilities enable the system to understand user input and transform it into specific visual features.
• Live2D technology integrationThe generated characters are output in Live2D format, which supports efficient rendering performance and flexible animation. Live2D technology, through multi-layered 2D rendering and skeletal rigging, gives characters rich expressions and movement capabilities. Textoon also integrates ARKit capabilities, further enhancing the animation expressiveness of the characters.
• High-efficiency rendering and compatibilityThe generated Live2D models have high rendering performance, are suitable for HTML5 rendering, and are suitable for use in mobile devices and web applications.

Textoon's project address

• Project official website:https://human3daigc.github.io/Textoon_webpage/
• arXiv technical paper:https://arxiv.org/pdf/2501.10020

Textoon's application scenarios

• Creative DesignTextoon helps designers quickly generate character prototypes, saving design time and costs. Through simple text descriptions, users can quickly create richly detailed 2D cartoon characters, which they can then edit and adjust.
• Game developmentIn game development, developers can use Textoon to quickly generate character prototypes for game concept design or directly apply them to character animations within the game.
• Animation productionTextoon can generate high-quality 2D cartoon characters based on detailed text descriptions, suitable for character design and animation production in animation. The generated characters can be used directly in animated videos or as a reference for animators.
• Literary creationFor literary creators, Textoon can visualize the characters in textual descriptions, helping authors better conceive the characters' appearances and personality traits, and enhancing the visual effect of their creations.
• Education and TrainingTextoon can be used to create instructional videos or interactive learning materials. By generating vivid 2D cartoon characters, it can provide students with a more intuitive and engaging learning experience, such as creating virtual teachers or animated explanations.