Mureka O1 - A large-scale music reasoning model launched by Kunlun Tech

What is Mureka O1?

Mureka O1, released by Kunlun Tech, is the world's first large-scale music reasoning model and the world's first music model to incorporate "Chain of Thought" (CoT) technology. Mureka O1 incorporates thinking and self-criticism mechanisms into the reasoning process, significantly improving music quality, creation efficiency, and flexibility. It supports pure music generation and AI music creation in 10 languages, covering various musical styles and emotional expressions, and features song reference and timbre cloning. Mureka O1 offers API services and model fine-tuning capabilities, helping developers and music platforms seamlessly integrate AI music generation capabilities.

Main functions of Mureka O1

• AI Lyrics CreationUsers input a theme or emotion, and the Mureka O1 can generate corresponding lyrics, helping users easily start creating.
• Style controlUpload reference audio, specifying the song style to ensure the work aligns with the artistic vision.
• Melody RecordingUsers can record melodic motifs, and the system will generate complete accompaniment based on these, improving creative efficiency.
• InspirationIt provides users with a platform for free expression and inspires creative ideas.
• Generate similar songsUpload a reference song, and Mureka O1 can quickly generate songs with similar styles.
• Tone selection and cloningUsers can specify the singer's gender and timbre, upload their own voice for the AI to learn and replicate, making the vocal part more personalized.
• Paragraph AdjustmentIt allows users to freely adjust sections such as the intro, verse, and chorus using tags.
• Extend or regenerate paragraphsAfter a song is created, users can extend the current piece as needed, or regenerate sections they are not satisfied with.
• Low-latency music generationThe Mureka O1 achieves industry-leading low-latency music generation through deep optimization of AI infrastructure, providing an instant, high-quality user experience.

Technical Principles of Mureka O1

• Chain of Thought (CoT) technologyMureka O1 introduces a thought chain technique, simulating the multi-step human thought process, breaking down the complex task of music generation into multiple steps of progressive reasoning. This allows the model to engage in deeper thinking and self-optimization during music generation, improving the quality and coherence of the music.
• Multi-round reasoningDuring the generation process, the model first performs initial creation, and then continuously reviews and optimizes the previous creation results in subsequent rounds, ultimately generating high-quality musical works.
• Structured generationUnlike traditional autoregressive models that generate audio incrementally, Mureka O1 pre-generates the overall music structure before predicting fine-grained audio tokens. This significantly improves the structural coherence of the generated music and the accuracy of instrument arrangement.
• Based on the CLAP modelMureka O1 is based on the CLAP model, which has high scalability without manual annotation, and improves the interpretability and quality of the generated music.
• Reinforcement learning optimizationThe Mureka O1 employs reinforcement learning techniques during training, continuously validating and correcting model performance. For example, in music generation, the model self-optimizes based on predefined reward functions (such as music quality, style consistency, etc.).
• Policy OptimizerThe model training phase utilizes a policy optimizer, including techniques such as gradient compression, exploration, and exploitation. These techniques help improve the training efficiency and generation quality of the model.
• Diverse data sourcesThe training data for Mureka O1 includes synthetic data, human expert-annotated data, and the CoT Dataset. These diverse data sources provide the model with rich learning materials.
• Training phaseDuring the training phase, the model is optimized through a reinforcement learning environment, while also utilizing reward functions (such as validation and human feedback) to guide learning. This enables the model to better adapt to different types of music composition tasks.

How to use Mureka O1

• Visit the official websiteVisit the official Mureka website and click "Create" to enter the creation interface.
• Register an accountRegister using your email or social media account, or log in directly.
• Select creation modeAfter entering the creation interface, select "Simple Mode" or "Advanced Mode".
  • Simple modeEnter a song description of no more than 300 characters, such as "a song full of sincere emotions, expressing deep longing for friends", and then click "Create".
  • Advanced modeIt offers more creative options, such as uploading reference songs and selecting singers' voices.
• Select ModelDepending on your needs, click to select a model such as Mureka O1 or Mureka V6.
• Enter lyricsEnter the song title and lyrics you have prepared in advance in the corresponding input box.
• Select reference musicYou can select music from the platform's built-in music library or upload local music as a reference to help the AI more accurately grasp the music style and emotion you want.
• Controlling music styleUse the Style function to select the style and mood of the music, such as traditional Chinese style or melancholic, to ensure that the generated music matches your creative intentions.
• Generate musicAfter completing the above steps, click "Create" to generate music using Mureka.

Application scenarios of Mureka O1

• Advertising and film productionAdvertising agencies and film and television production teams can use Mureka O1 to quickly generate background music for advertising, short videos, movies and other projects, and customize unique soundtracks according to scene requirements.
• Brand Music CreationBrands can use the Mureka O1 to create unique brand music, and event organizers can customize theme music for different occasions.
• Game developmentGame developers can use Mureka O1 to create unique soundtracks and audio assets for video games.
• Music EducationMusic education institutions can use the Mureka O1 as a teaching tool to help students understand the music creation process, encourage them to create music, and enhance their interest in learning.
• Videos and podcastsContent creators can use Mureka O1 to generate custom background music for videos, podcasts, or other media projects, enhancing the appeal of their content.