Ziyue Translation 2.0 - NetEase Youdao's latest large-scale translation model
Ziyue Translation 2.0 is the latest large-scale translation model launched by NetEase Youdao. The model has undergone systematic upgrades in three key dimensions: data, algorithms, and evaluation, achieving a qualitative leap in translation quality, efficiency, and robustness. At the data level...
What is Confucius Translation 2.0?
Ziyue Translation 2.0 is the latest large-scale translation model launched by NetEase Youdao. The model has undergone systematic upgrades in three key dimensions: data, algorithm, and evaluation, achieving a qualitative leap in translation quality, efficiency, and robustness. At the data level, Youdao has collected and cleaned tens of millions of high-quality translation data points, covering multiple fields such as academics, news, and medicine. These data points have been meticulously annotated by professionals, providing rich and accurate data resources for model training. Algorithmically, it utilizes a secondary pre-training process based on the Ziyue Education large-scale model, combined with large-scale model distillation and fusion techniques, and Online DPO technology, significantly improving translation accuracy and fluency while avoiding the "catastrophic forgetting" problem common in large-scale models.
The main functions of Ziyue Translation 2.0
- High-quality Chinese-English translationThe Ziyue Translation Model 2.0 performs exceptionally well in Chinese-English translation, providing accurate and fluent results. It has achieved outstanding results on the internationally authoritative WMT and Flores200 test sets, far surpassing general-purpose large-scale models and specialized translation models both domestically and internationally.
- Professional translationIt can accurately translate technical terms and complex sentences in academic papers, ensuring that the translation results conform to academic standards, and can accurately translate English abbreviations into computer-related terms.
- Multi-scenario translation supportSuitable for everyday communication, it provides natural and fluent translations. When translating classical poems and other literary works, it preserves the original meaning and maintains rhyme, making the translation more literary.
The technical principles of Ziyue Translation 2.0
- Data level
- High-quality corpus collection and cleaningWe meticulously collected and rigorously cleaned tens of millions of high-quality translation data, covering multiple fields such as academia, news, and medicine, to ensure the accuracy and suitability of the data, laying a solid foundation for model training.
- Refined manual annotationThe data is meticulously annotated manually by certified English majors and professional translators to improve the quality of the annotation and provide precise guidance for the model to perform translation tasks.
- Algorithm level
- Secondary pre-trainingBased on the Confucius's teaching model, a second pre-training process is conducted to create a more professional and targeted translation foundation model, significantly improving translation performance.
- Large-scale distillation technologyWhile simplifying model parameters, it significantly improves running efficiency and inference speed.
- Large model fusion technologyIntegrating the advantages of multiple models enhances the accuracy and stability of translation.
- Online DPO technology: Dynamically adjust the model generation strategy to ensure improved translation quality and fluency.
- reinforcement learningTranslation data based on human preferences is automatically acquired and subjected to reinforcement learning to further optimize translation results.
- Multi-task collaborative learningThe goal is to enable the model to improve collaboratively across multiple translation tasks, thereby enhancing its overall translation capabilities.
- Assessment level
- Comprehensive annotation and strict separationThe development set and blind test set are manually labeled to cover various fields, and the development set and blind test set are strictly separated to ensure the objectivity and accuracy of the evaluation.
- Self-developed evaluation modelWe have independently developed the Reward Model, a translation evaluation model that surpasses the accuracy of COMET, providing a reliable quantitative basis for performance evaluation.
- A comprehensive manual evaluation schemeWe conduct detailed analysis and evaluation of the model's translation results from multiple dimensions to ensure translation quality.
How to use Ziyue Translation 2.0
- Access Youdao TranslateAccess Youdao TranslateOfficial website.
- Select AI translationThis refers to the "Confucius Says Translation Model 2.0".
- Input textEnter the text to be translated and select the translation language pair.
Application Scenarios of Ziyue Translation 2.0
- Academic paper translationThe Ziyue Translation Model 2.0 performs exceptionally well in academic paper translation, accurately translating technical terms and complex sentence structures, ensuring that the translation results conform to academic standards.
- Financial Statement TranslationWhen translating financial reports, Ziyue Translation Model 2.0 can generate translations that conform to Chinese expression habits, with clear logic and easy understanding.
- Medical TranslationThe Ziyue Translation Model 2.0 can accurately translate medical terminology, avoiding misunderstandings caused by translation errors.
- Translation of ancient poemsIn the field of literary translation, the Ziyue Translation Model 2.0 can preserve the original meaning and rhyme, making the translation more literary.
- Daily conversation translationThe Ziyue Translation Model 2.0 can handle complex sentence structures and professional terminology in various daily conversations, ensuring the accuracy and fluency of the translation.