Project Mariner - Google's intelligent web browsing assistant that helps users manipulate spreadsheets and shop online.

What is Project Mariner?

Project Mariner is a browser assistant developed by Google DeepMind. Based on Gemini 2.0 technology, Project Mariner uses a Chrome extension to automate browser operations, understanding and executing web page tasks. It can understand and reason about information on the browser screen, including pixels and web page elements, and use this information to complete tasks via the Chrome extension. Project Mariner can control the Chrome browser, move the cursor on the screen, click buttons, and fill out forms, using and browsing websites like a human. Project Mariner achieved a high score of 83.5% in the WebVoyager benchmark. Currently, Project Mariner can only perform typing, scrolling, and clicking operations within the browser's active tab, and requires final confirmation from the user before performing certain sensitive operations (such as purchasing items).

Project Mariner's main functions

• Multimodal understandingIt understands all content on the browser screen, including data such as pixels, text, code, images, and forms.
• Browser InteractionReal-time navigation and operation of complex websites, automating tasks within the browser, and maintaining user control.
• Automated tasksIt automatically interacts with the browser to organize and populate data in other areas of the webpage, while also organizing the data according to the user's requirements.
• Complex instruction processingIt can understand and execute complex user instructions, breaking them down into executable steps.
• Relationship UnderstandingUnderstand the relationships and functions between different web page elements.
• Visual feedbackProvide visual feedback and updates while performing tasks to keep users informed of progress.
• SecurityBefore performing sensitive operations (such as shopping and making payments), users will be required to provide final confirmation to ensure security.

How to use Project Mariner

Project Mariner is currently in early testing and is only open to a limited number of testers. Access to Project Mariner is limited.Official websiteAdd to the waiting list.

Application scenarios of Project Mariner

• Data cleaning and replicationCopying data from a webpage into a spreadsheet for organization, such as extracting information from a webpage that stores large amounts of data and organizing it into spreadsheet software like Excel.
• Online shoppingBased on the user's shopping list, automatically search for products on e-commerce websites and add them to the shopping cart.
• Travel planningIt helps users find flight and hotel information, automating web browsing and information comparison during the travel planning process.
• Daily shopping: Enables users to shop on retail websites, such as searching for and purchasing household goods.
• Recipe search: Automatically search and select recipes based on user needs on recipe websites.