AB
AiBoss
project

BiliNote - an open-source AI video note-taking tool that automatically extracts video content and generates Markdown format.

BiliNote is an open-source AI video note-taking assistant that supports automatically extracting video content from video links such as Bilibili and YouTube to generate well-structured and concise Markdown format notes.

What is BiliNote?

BiliNote is an open-source AI video note-taking assistant that supports automatically extracting video content from links on platforms like Bilibili and YouTube to generate well-structured, concise Markdown notes. BiliNote supports local audio transcription (e.g., Fast-Whisper) and large model summarization (e.g., OpenAI, DeepSeek, Qwen). It offers practical features such as screenshot insertion, content navigation links, and task recording. BiliNote provides an efficient and convenient solution for video learning and content organization.

BiliNote's main functions

  • Multi-platform support: Processes video links from platforms such as Bilibili and YouTube.
  • Automatic note generationAutomatically transcribes video content into clear Markdown notes for easy organization and review.
  • Audio transcriptionSupports audio transcription using local models (such as Fast-Whisper).
  • Summary of large modelsIt summarizes video content and extracts key information based on large models such as OpenAI, DeepSeek, and Qwen.
  • Screenshot InsertAutomatically extracts keyframes from videos and inserts notes to help users better understand the content.
  • Content jump linkAdd a link to the original video in the notes so that users can easily review the relevant clips at any time.
  • Task Log and History ReviewSaves the user's note-generating history, making it easy to view and manage previous notes at any time.

BiliNote's technical principles

  • Backend servicesFastAPI builds backend services, handling core logic such as video parsing, audio transcription, and content summarization. FastAPI is a modern, fast (high-performance) web framework suitable for building API services.
  • Front-end interfaceVite + React is used to build the front-end interface, providing a user-friendly interactive experience. Users can input video links, view generated notes, manage task records, and more through the front-end interface.
  • Front-end and back-end communicationThis system uses HTTP requests and responses to exchange data between the front-end and back-end. The front-end sends information such as video links to the back-end, and the back-end processes the data and returns the generated notes to the front-end for display.
  • Environment variable configurationBiliNote offers flexible environment variable configuration, allowing users to configure parameters such as API keys, model selection, and storage paths as needed.
  • Docker deploymentIt supports one-click deployment using Docker, making it easy for users to quickly start and run BiliNote in different environments.

BiliNote project address

Application scenarios of BiliNote

  • Learning and EducationStudents organize their online class notes, and teachers optimize their teaching content.
  • Content creationCreators organize video scripts and extract key information from source materials.
  • Corporate TrainingCompanies compile internal training courses, and employees review the training content.
  • Research AnalysisResearchers compile academic lectures, and analysts extract key information.
  • Personal knowledge managementOrganize videos of interest, build a knowledge base, and record learning experiences.