Google just unveiled an AI assistant that doesn't just help you work — it builds a permanent, expanding dossier on every task, conversation, and document you touch. The company calls it the "Gemini agent," a "new single, universal agent for work" announced at Gemini at Work 2026, and it's the most comprehensive workplace surveillance tool ever packaged as productivity software.
Here's why it matters: this agent doesn't just answer questions or draft slides. It retains four distinct categories of memory — session memory for active tasks, semantic memory as "a structured knowledge base it builds as it reads documents, talks to people, and works with other agents," procedural memory for skills it teaches itself, and episodic memory covering "everything it has done before." That's not an assistant. That's a permanent record of your professional life, housed in Google's cloud, feeding what the company calls "one personalization graph."
According to 9to5Google, the Gemini agent runs on whatever model suits the job — Gemini, Claude, or others — and communicates with sub-agents to coordinate multi-step workflows that "can run for hours or days." It can be invoked with an @ mention across Gmail, Docs, Sheets, Slides, and Chat. It integrates with Slack and Microsoft 365. And it can operate as a "headless agent, meaning it does not need a dedicated user interface" — translation: it works invisibly in the background.
Google frames all of this as convenience. Your manager emails asking for a slide deck? One click and Gemini handles it. Need to schedule a meeting with regional leads? Gemini figures out who they are from your chat history and calendar threads, then coordinates everything. Fortune, meanwhile, buried the Google announcement in a roundup and led instead on Microsoft's own agentic AI push — a Windows revamp that embeds Copilot directly into the operating system. Microsoft CEO Satya Nadella called Windows a "hybrid intelligence" system, and Copilot head Jacob Andreou boasted that "Copilot now truly understands your PC," autonomously pulling files for tasks like tax preparation without cloud access.
The two stories together paint the real picture: Big Tech is in an arms race to embed AI agents into every layer of your digital life. Google wants the cloud-side comprehensive profile; Microsoft wants the device-side intimacy. Either way, the user surrenders visibility into every corner of their work.
9to5Google noted the Gemini agent will be available "soon for Workspace customers with select Business and Enterprise plans" and is currently in private preview. No word on data retention policies, deletion rights, or what happens to your "episodic memory" when you leave a job.
The same company that already controls what most Americans find online, monetizes their attention, and has a documented history of suppressing disfavored speech now wants a single cloud-based graph of everything you do at work — and it wants you to thank them for the convenience. Microsoft is building the same apparatus on the device side. The question isn't whether these agents are useful. The question is who owns the memory when the work is done.
