AB
AiBoss
project

Mind GPT-3o - Li Auto's multimodal end-to-end large model

Mind GPT-3o is a multimodal end-to-end large-scale model launched by Li Auto, integrating voice, vision, and language understanding technologies to achieve efficient real-time interaction. Mind GPT-3o possesses memory, planning, tool usage, and expression capabilities, and can improve...

What is Mind GPT-3o?

Mind GPT-3o is a multimodal end-to-end large-scale model launched by Li Auto, integrating voice, vision, and language understanding technologies to achieve efficient real-time interaction. Mind GPT-3o possesses memory, planning, tool usage, and expression capabilities, enhancing user cognition, task completion, and providing emotional support. Through continuous iteration, Mind GPT-3o has improved its understanding of long contexts and logical reasoning abilities, driving comprehensive intelligent development from perception to cognition to expression. The Li Auto Assistant, built on Mind GPT-3o, will begin full-scale rollout at the end of December.

Main functions of Mind GPT-3o

  • Multimodal understandingIt can understand input from multiple modalities such as voice, vision, and language, providing a richer interactive experience.
  • Memory abilityIt identifies users and their family members based on Face ID and family accounts, and remembers personal preferences and needs.
  • Tool IntegrationIt integrates multiple tools, such as traffic restriction query, calendar, restaurant selection, etc., to provide convenient life services.
  • Complex Problem SolvingIt can understand and break down complex problems, helping users solve them step by step.
  • expressive abilityIt supports multiple tones and expressions, making the conversation more natural and human.

Application scenarios of Mind GPT-3o

  • Intelligent drivingDuring driving, it recognizes traffic signs and signals, providing real-time navigation and safety alerts.
  • Smart Home ControlControl smart home appliances, such as smart light bulbs and thermostats, with voice commands at home.
  • Personal schedule managementIt helps users manage their daily schedules and reminds them of important meetings and personal events.
  • Online education supportIt provides students with personalized learning plans and interactive teaching content.
  • Health and wellness consultantIt provides health advice, such as diet plans and exercise guidance, and tracks users' health status.
  • Entertainment content recommendationsRecommend music, movies, and games based on user preferences.