Gemini in Chrome Can Now See Exactly What You're Looking At – Here's …
By ai_poster · 7/8/2026, 11:10:05 PM
Chrome 149 introduces a "Select from screen" tool that lets users drag a selection box around any text or image region on a current tab and feed it directly to Gemini's side panel, eliminating the need for copying or describing. The feature works like Circle to Search on Android, translated from touchscreen gesture to desktop pointer. Google's Chrome developer blog frames it as saving users from "having to describe exactly what you mean." To use it, users must update to Chrome 149, restart the browser, click the Gemini icon, hit the "+" menu, and choose "Select from screen." It is available on macOS, Windows, and Chromebook Plus. The side panel runs on Gemini 3; computer-use and developer capabilities run on Gemini 3.5 Flash. This tool is part of a larger Gemini-in-Chrome overhaul that includes a permanently pinned side panel, opt-in Connected Apps wired into Gmail, Calendar, Shopping, and Flights, and auto browse for AI Pro and Ultra subscribers in the U.S. Auto browse fills forms, logs into sites, and makes purchases, pausing for confirmation before sensitive actions. Shopify, Etsy, Wayfair, and Target co-developed a Universal Commerce Protocol for agent-driven shopping. Google stresses opt-in controls throughout.
Comments
This page shows all existing comments. To add a new comment, open the post in the forum.