LeVo - An AI singing model developed by Tencent AI Labs
LeVo is an AI singing model developed by Tencent AI Labs. It boasts powerful timbre cloning capabilities, accurately replicating a target timbre—including pitch, emotion, and rhythm—with just 3 seconds of audio, without requiring extensive training data. LeVo supports track-by-track generation...
What is LeVo?
LeVo is an AI singing model developed by Tencent AI Labs. It boasts powerful timbre cloning capabilities, accurately replicating a target timbre—including pitch, emotion, and rhythm—with just 3 seconds of audio, without requiring extensive training data. LeVo supports separate track generation, producing vocal and accompaniment tracks separately, facilitating post-editing. Its technical architecture is based on a language model (LM), combining LeLM and a music codec to generate tracks in parallel. The sound quality is close to industry-leading levels, with exceptional lyric alignment capabilities.
LeVo's main functions
-
Zero-sample timbre cloningIt can accurately reproduce the target timbre, including pitch, emotion and rhythm, with just a 3-second audio clip, without the need for a large amount of training data.
-
Track generationLeVo supports a dual-track generation mode, which can generate vocal and instrumental tracks separately, providing greater flexibility for post-production mixing and editing.
-
High-fidelity music performanceLeVo delivers near-industry-leading sound quality, particularly excelling in musicality, vocal and accompaniment harmony, and overall sound quality (MOS score). It optimizes generated results through a multi-preference alignment method, ensuring high fidelity across various styles and scenarios.
LeVo's technical principles
- Language model architectureLeVo employs a Language Model (LM) architecture, combining LeLM and music codecs to generate high-quality music in parallel.
LeVo's performance
-
It rivals the industry-leading Suno 4.5 in many key metrics.
-
In terms of lyrics alignment (LYC), LeVo scored 0.21 points higher than Suno 4.5, demonstrating superior text control capabilities.
LeVo's project address
- Project official website: https://levo-demo.github.io/
LeVo application scenarios
-
Solo music creatorIt provides a low-threshold, high-quality music creation platform for individual users who love music creation but lack professional skills.
-
professional music producerThe track generation function and high-fidelity music performance can improve creative efficiency and quality.
-
Music Education InstitutionsIt can be used to provide students with a vivid and interesting music teaching experience.