MnnLlmApp - Alibaba's open-source offline large-scale model Android mobile application AI assistant

What is MnnLlmApp?

MnnLlmApp is an open-source Android mobile application developed by Alibaba based on the MNN-LLM framework. It supports offline execution of various large language models (LLMs) on mobile devices. It features multimodal capabilities, enabling tasks such as text-to-text, image-to-text, audio-to-text, and text-to-image conversion. The application has undergone deep optimization for CPU inference, with pre-filling and decoding speeds significantly outperforming similar products, ensuring efficient local operation. MnnLlmApp supports multiple mainstream models, such as Qwen, Gemma, and Llama, allowing users to select different models for task processing as needed.

Main functions of MnnLlmApp

• Multimodal interactionIt supports multiple input/output methods, including text-to-text, image-to-text, audio-to-text, and text-to-image (based on a diffusion model). Users can input text, images, or voice to obtain the corresponding generated results.
• Model selection and switchingIt includes multiple mainstream large language models (LLM), such as Qwen, Gemma, Llama, and Baichuan, allowing users to choose different models according to their needs.
• Run offlineAll functions run on the local device without an internet connection, ensuring data privacy and security.
• Performance optimizationIt has been deeply optimized for mobile CPU inference, significantly improving pre-filling and decoding speeds, and providing faster response times compared to similar applications.
• Local storageIt supports saving the generated content locally, making it convenient for users to view and use it at any time.

How to use MnnLlmApp

• Download and installThe application can be downloaded directly from the Releases page, or developers can build the application themselves.
• Self-build compilation steps:
  • Cloning the code repository: Accessing the Github repository:https://github.com/alibaba/MNN.
  • Build library: Enter project/android Navigate to the directory and run the build script.
  • Copy to the LLM Android application project.
  • Build and install the Android application project.

Application Scenarios of MnnLlmApp

• Content creation and generationUsers can use the application to generate text content, such as writing articles, creating stories, and generating copy.
• Smart AssistantAs an intelligent assistant, MnnLlmApp can interact with users in natural language, answer various questions, and provide services such as information retrieval and learning guidance.
• Language learningIt helps users practice language expression, correct grammatical errors, and even provides language translation functions.
• Creativity and DesignThis tool provides creative inspiration for designers and artists through text and image generation capabilities. It automatically generates advertising copy, social media copy, and more, improving content creation efficiency.