AB
AB
AiBoss

All Categories

project

RTranslator - an open-source offline, real-time, multilingual translation application.

RTranslator is an open-source, free, offline real-time translation application designed specifically for Android devices. It is based on advanced AI technologies, including Meta's NLLB translation model and OpenAI's Whisper speech recognition...

What is RTranslator?

RTranslator is an open-source, free, offline real-time translation application designed specifically for Android devices. Based on advanced AI technologies, including Meta's NLLB translation model and OpenAI's Whisper speech recognition, it achieves high-quality multilingual translation. Users can engage in real-time voice communication with others through conversation mode or have quick, short conversations using walkie-talkie mode. RTranslator also offers a text translation mode suitable for translating written content. RTranslator supports multiple languages, works entirely offline, and protects user privacy. RTranslator requires a phone with at least 6GB of RAM for smooth operation.

Main functions of RTranslator

  • Dialogue modeRTranslator's core function is to enable real-time voice conversations between users and others who have the same application installed. The user's voice is captured, converted into text, translated into the other person's language, and then played back through the other person's device, achieving two-way communication.
  • Walkie-talkie modeSuitable for quick, short conversations, such as asking for directions or communicating with service personnel. Users need to take turns speaking, and the phone recognizes the language spoken and translates it into another language, which is then played back through the speaker.
  • Text translation modeIt provides traditional text translation services, where users input or paste text and select the source and target languages for translation.
  • Running in the backgroundRTranslator runs in the background, allowing users to continue working while using other apps or while their phones are in standby mode.
  • Privacy protectionSince the translation and speech recognition process is carried out entirely on the user's device and does not rely on cloud services, it can protect the user's privacy.
  • Multilingual supportIt supports multiple languages, including but not limited to English, Chinese, Japanese, Korean, French, German, etc., covering major languages worldwide.

RTranslator Technical Principles

  • Speech recognitionWhisper, an open-source speech recognition system based on OpenAI's Whisper model, converts user speech input into text.
  • Text translationText translation based on Meta's NLLB (No Language Left Behind) model converts text from one language to another.
  • Text-to-speech (TTS)The translated text is converted into speech output using the mobile phone system's TTS engine, such as Google TTS.
  • Bluetooth connectionIn conversation mode, RTranslator connects to headphones or other devices via Bluetooth to receive and play translated speech in real time during conversations.
  • Local processingAll processing (speech recognition, translation, text-to-speech) is performed on the user's device, without requiring an internet connection, ensuring privacy and data security.
  • Model optimizationDevelopers optimize AI models, including converting to ONNX format, INT8 quantization, and model separation, to reduce memory consumption and improve execution speed.
  • Multilingual supportRTranslator supports multiple languages and, thanks to the training of NLLB and Whisper models, can handle the translation and recognition of multiple languages.

RTranslator project address

Application scenarios of RTranslator

  • International travelTourists can communicate with locals in real time while traveling abroad without worrying about language barriers.
  • Business MeetingBusiness professionals use RTranslator during international conferences or negotiations to ensure effective communication with foreign partners.
  • Language learningLanguage learners practice listening and speaking skills by conversing with native speakers of the target language.
  • Social interactionIn international social activities, users use RTranslator to communicate with friends from different countries.
  • EmergencyIn situations requiring urgent communication, such as in a hospital or police station, RTranslator helps quickly overcome language barriers.
  • Educational environmentTeachers and students use RTranslator to facilitate communication and understanding in a multicultural teaching environment.
Back