AB
AB
AiBoss

All Categories

project

AI-Media2Doc - An open-source AI-powered text and image creation assistant that converts audio and video content into documents with a single click.

AI-Media2Doc is an open-source audio/video to document conversion tool. Based on AI large-scale model technology, it supports intelligent conversion of audio/video content into various document formats such as Xiaohongshu notes, WeChat official account articles, knowledge notes, mind maps, and video subtitles.

What is AI-Media2Doc?

AI-Media2Doc is an open-source audio/video to document conversion tool. Based on AI large-scale model technology, it supports intelligent conversion of audio/video content into various document formats, including Xiaohongshu notes, WeChat official account articles, knowledge notes, mind maps, and video subtitles. The tool supports pure front-end processing, requiring no local ffmpeg installation, and task records are saved locally, ensuring user data security. AI-Media2Doc is suitable for content creators, students, researchers, and other groups, helping them efficiently extract and organize information.

Main functions of AI-Media2Doc

  • Audio/video to document conversionIt can convert audio and video content into various document styles with one click, including Xiaohongshu notes, WeChat official account articles, knowledge notes, mind maps, and video subtitles.
  • AI intelligent processingBased on large model technology, it enables content summarization and multi-style document generation, and supports AI question answering and secondary dialogue based on video content.
  • Pure front-end processingBased on ffmpeg wasm technology, it does not require local installation of ffmpeg and supports direct processing in the browser.
  • Privacy protectionNo login or registration is required; task records are stored locally, ensuring user data security.
  • Local deploymentSupports local operation and one-click deployment based on Docker, making it convenient for users to use in their local environment.
  • Multiple export formatsThe generated documents and mind maps can be exported to third-party platforms for further editing and sharing.

How to use AI-Media2Doc

  • Local deployment:
    • Cloning project codeOpen a terminal or command-line tool and run the following command to clone the project code.
git clone https://github.com/hanshuaikang/AI-Media2Doc.git
cd AI-Media2Doc
    • Install Python dependencies (backend)): Installs the Python dependencies required for the project.
pip install
-r backend/requirements.txt
    • Configure environment variablesCreate a .env file in the backend directory and fill in the API key.
OPENAI_API_KEY=your_openai_api_key
GROK_API_KEY=your_grok_api_key
DEEPSEEK_API_KEY=your_deepseek_api_key
    • Start the FastAPI serviceStart the backend service.
uvicorn backend.main:app --reload
    • Install frontend dependencies and start the service.Install frontend dependencies and start the frontend service.
cd frontend
npm
install
npm run serve
    • Access local serverTo start using it, open your browser and visit http://localhost:8080.
  • How to use:
    • Create a new taskCreate a new task on the page, upload audio or video files or enter an external link address.
    • Select output styleChoose the desired document style, such as Xiaohongshu, WeChat Official Account, knowledge notes, mind map, etc.
    • Generate images and textClick the "Generate" button, and the system will automatically process the audio and video content to generate the corresponding document.
    • Second dialogueEnter a question on the right side of the screen (such as "What is the main idea of the video?"), and the AI will answer based on the content.
    • Export ResultsThe generated documents and mind maps can be exported to third-party platforms, such as Mubu and ProcessOn, for further editing and use.

AI-Media2Doc project address

Application scenarios of AI-Media2Doc

  • Student learningExtract online course notes and mind maps for easy review.
  • Teacher's lesson preparationConvert videos into lesson plans to quickly organize course content.
  • Self-media creation: Deconstruct videos to generate images, text, scripts, or screenplays, providing creative inspiration.
  • Knowledge ManagementConvert videos into structured notes for easier management and review.
  • Content creation: Share videos to WeChat official accounts or Xiaohongshu (Little Red Book) for better content creation efficiency.
Back