AB
AB
AiBoss

All Categories

project

Glass - An open-source AI desktop assistant that captures screen content and performs audio recognition in real time.

Glass is an open-source, stealth AI desktop assistant developed by the Pickle team. Glass can capture screen content and audio in real time in the background and transform it into structured knowledge. Glass's core functions include real-time meeting recording, automatic summarization, etc.

What is Glass?

Glass is an open-source, invisible AI desktop assistant developed by the Pickle team. Glass can capture screen content and audio in real time in the background and transform it into structured knowledge. Glass's core features include real-time meeting recording, automatic summary generation, contextual understanding, and real-time question answering. Glass is truly invisible; it doesn't appear in screen recordings, screenshots, or the Dock, and it doesn't interfere with user operations at all. Glass supports macOS and Windows systems, is free to use, and requires no registration. Glass's open-source nature makes it an emerging tool in the field of AI-powered office and knowledge management.

Main functions of glass

  • Real-time screen capture and audio recognitionGlass can listen to and capture screen content and audio (such as conference voice) in real time and convert them into structured information.
  • Contextual understanding and summaryIt combines visual and auditory information to automatically generate high-quality meeting notes, summaries, and task lists.
  • Real-time Q&A AssistantUsers can ask questions at any time, and AI will provide answers based on previous screen operations and audio content.
  • Invisible designGlass is completely invisible and does not appear in screen recordings, screenshots, or the Dock, thus not interfering with user operations.
  • Meeting minutes and summaryAutomatically records meeting content, identifies speakers, extracts key information, and generates a summary.
  • Knowledge AccumulationThe user's actions and voice interactions are recorded as knowledge documents for easy reference and review later.

How to use Glass

  • macOS users:
    • Download pre-compiled versionVisit the Glass GitHub Release page. Download the latest version of the .dmg file (recommended) or .zip archive. Open the .dmg file and drag the Glass application into the "Applications" folder.
    • Running GlassLocate Glass in the "Applications" folder and double-click to launch it.
    • Configuration and useAfter opening Glass, follow the on-screen prompts to configure it, such as entering the OpenAI API Key (optional). Use keyboard shortcuts (such as Cmd + \ to show/hide the main window, and Cmd + Enter to call the AI assistant) to get started.
  • Windows users:
    • Install dependenciesEnsure that Python and Node.js are installed (Node.js 20.x.x is recommended). If not, install Node.js using the following command:
curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.39.0/install.sh |
bash
nvm install
20
nvm use 20
    • Cloning and installing projectsOpen a terminal or command prompt and run the following command to clone the project:
git clone https://github.com/pickle-com/glass.git
cd glass
    • Install project dependencies:
npm run setup
    • Running GlassTo start Glass, run the following command in the project root directory:
npm start
    • Configuration and useAfter opening Glass, follow the on-screen prompts to configure it, such as entering the OpenAI API Key (optional). Use keyboard shortcuts (such as Ctrl + \ to show/hide the main window, and Ctrl + Enter to call the AI assistant) to get started.

Glass's project address

  • GitHub repositoryhttps://github.com/pickle-com/glass

Applications of Glass

  • Meeting minutes and summaryCapture screen content and audio in real time during remote or local meetings, and automatically generate meeting notes, summaries, and action items to help teams efficiently record and follow up on key meeting points.
  • Academic and TeachingAutomatically record content and generate structured notes in classrooms or academic conferences to help students and researchers better review and organize knowledge, thereby improving learning and research efficiency.
  • Teamwork and Project ManagementIn team discussions and project meetings, task lists and to-do items are generated in real time to help team members clearly understand task assignments and progress, thereby improving collaboration efficiency.
  • Personal knowledge managementIn daily learning or work, screen operations and voice interactions can be transformed into knowledge documents, helping individual users to efficiently organize knowledge for easy reference and review later.
  • Office AssistanceWhen handling work tasks, it answers questions in real time, provides background information and suggestions, helps users complete tasks quickly, and improves work efficiency.
Back