Chrome AI

Chat with Chrome built-in AI (Gemini Nano)

Built-in AI refers to AI models, including large language models (LLMs) like Gemini Nano, that are integrated directly into the browser. This allows websites and web applications to perform AI-powered tasks without needing to deploy or manage their own AI models.

Gemini Nano is the most efficient version of the Gemini family of LLMs, designed to run locally on most modern desktop and laptop computers.

  1. Download Chrome 128 from Dev or Canary channel
  2. Open chrome://flags/#optimization-guide-on-device-model, set it to Enabled BypassPerfRequirement
  3. Open chrome://flags/#prompt-api-for-gemini-nano, set it to Enabled
  4. Open chrome://components/, find Optimization Guide On Device Model, ensure it’s fully downloaded
  5. Relaunch Chrome

While server-side AI is great for large models, built-in AI offers advantages in terms of privacy, speed, and offline capabilities. A hybrid approach, using both on-device and server-side AI, can be beneficial for many use cases.

Built-in AI can be used for tasks such as summarization, rephrasing, categorization, and other language-related use cases that can benefit from on-device processing.

There are currently limited resources about Chrome AI. You can read this article and this document.