In brief
- Google launched computer use for its Gemini Mac app, allowing the AI to click through desktop applications and websites while users keep working.
- The agent runs in a separate virtual screen, with app permissions, live previews, and confirmation requests for sensitive actions.
- Google warns that malicious content, broad app access, and imperfect backups can still put user data and files at risk.
Google wants Gemini to do more than answer questions on your Mac.
The company launched a computer-use feature Thursday that lets its AI assistant open applications, navigate menus, fill out forms, and move information between local files and websites on a user's behalf.
“Starting today, computer use in the Gemini app for Mac helps you get multi-step tasks done across your local files, desktop apps, and the web,” Google announced. “Just describe what you need, and Gemini handles the clicking, typing, menus, and forms for you.”
AMZN Lows in November
2004%YesNo2084%YesNo2167%YesNo22416%YesNo23228%YesNo+2 more outcomes+1 more outcomesNEW$0.00volumeDec 1Closes: Dec 1, 2026, 04:59 UTCCloses: Dec 1, 2026, 04:59 UTCThe new capability runs in what Google calls an isolated background window, leaving the computer's main display and cursor available for the owner. Users can watch the agent's actions through a live preview inside the Gemini chat and interrupt a task if it goes off course.
Google's examples include extracting shipping details from PDF documents and entering them into online forms, editing batches of photos, and building presentations from dashboard data. The company also suggests researching prices and preparing resale listings based on pictures stored on a Mac.
Those jobs involve a different kind of AI interaction than asking a chatbot to write instructions. Gemini is supposed to operate the software itself, carrying out the clicks and keystrokes that would otherwise fall to the user.
A background worker with access to your apps
The feature is rolling out in English in the United States to adult users with personal paid Google accounts. It requires an Apple Silicon Mac running macOS Sequoia 15.0 or later; work and school accounts are not supported at launch.
To activate it, users enable computer use in the Mac app, open Task mode, and prompt Gemini with @Computer use. According to Google's support documentation, the assistant asks for permission before controlling a new app, with options to deny access, allow it once, or allow it on an ongoing basis.
Users can create lists of allowed and blocked apps, monitor the virtual screen, and stop a task. Google says sensitive actions require confirmation before the agent proceeds, though an app marked "always allow" can be accessed again without another app-level prompt.
BitcoinBTC · USD$58,992−14%Nov 13Nov 15Nov 17Nov 19Nov 20$69.1k$65.7k$62.3k$59.0k24h HighHigh$63,21924h LowLow$58,811VolVol$2.0BMarket projectionsOdds by MyriadTodayAbove $58,000Above $58k74% chanceThis weekAbove $58,000Above $58k74% chance
→
Buy Bitcoin with USDCPowered by JupiterPrice data by CoinGeckoCoinGeckoMore Bitcoin news and projections →Computer use adds a local dimension to Google's agent strategy. Decrypt previously covered Gemini Spark, the company's cloud-based task agent, while competitors have developed desktop-control tools including OpenAI's Codex, Anthropic's Claude, and Kimi Work.
The separate window is also a practical distinction: an agent that commandeers the visible cursor can make a computer difficult to use during a long task. Google's approach lets the person keep working while Gemini handles another workflow.
What happens when the agent makes a mistake?
A background window should not be confused with a guarantee that files or accounts are isolated from risk. Google's own documentation warns that the agent can reach active sessions in desktop applications, encounter authentication codes displayed on screen, and take actions that some apps cannot reverse.
In that case, any error is the user’s fault, not Google’s.
It also warns about prompt injection, an attack in which malicious instructions hidden in a document or website persuade an AI system to do something its user never requested. With permission to operate multiple apps, Gemini could encounter hostile content in one program and act on it in another.
Google offers optional on-demand file backups but says they cannot always be created. Where they work, the temporary copies remain available for 24 hours or until the next prompt, and some applications may prevent their content from being backed up at all.
The launch also comes three days after Apple introduced tighter access controls in the macOS 27.3 beta. Those changes give users more ways to restrict powerful permissions to specific apps or folders and to require fresh approval each time access is requested.
It also requires users to give up a lot of privacy in exchange for convenience. Its help center says users must also enable macOS Accessibility and Screen & System Audio Recording permissions before Gemini can take control of desktop apps.
Daily Debrief Newsletter
Start every day with the top news stories right now, plus original features, a podcast, videos and more.
Join 72,000+ readersCreate an accountto save your articles.Add on GoogleAdd Decrypt as your preferred source to see more of our stories on Google.