Does Your AI Get Dumber the Longer It Works?


Your Weekly AI Briefing for Leaders

Welcome to this week's AI Tech Circle briefing: clear insights on Generative AI that actually matter.

This was the week AI opened its books. Anthropic filed to go public, and we all got to read a frontier lab's real numbers. Meanwhile, the hard lesson of the week is quieter: bigger context windows do not make AI smarter. This issue shows you six fixes that do.

Today at a Glance

  • Executive Brief - Anthropic files its S-1; Google gates Gemini 4 Carbon; OpenAI takes frontier training offline
  • Deep Dive - Context engineering: six fixes for agents that get dumber as they work
  • Weekly News & Updates - GPT-6.1 Terra's price cut, Kimi K3.1 Pro, Block's Dessa, Opera WebAI
  • Favorite Tip of the Week - The 15-minute context reset
  • Potential of AI - Worlds on demand: Genie 4 and simulation-trained robots
  • The Opportunity… - This week's Open Tech Talks episode
  • Courses, Events, Tool Spotlight, and The Investment in AI

Executive Brief

1. Anthropic opens its books: the S-1 is in. Four weeks ago we covered the IPO target - this week the filing arrived. On Monday, Anthropic filed its S-1 to list on Nasdaq under the ticker "ANT". The numbers are startling. Revenue hit $16.3B in the first half of 2026, up from $4.6B for all of 2025. Q2 delivered the first operating profit: $974M. The headline $80.7B net loss is mostly paper - non-cash accounting, not cash burned. Reports place the expected valuation between $1.5T and $2T. Goldman Sachs and Morgan Stanley lead the offering. The prospectus also discloses compute commitments of up to $120.5B with a single provider into 2029. And it warns, in Anthropic's own words, that AI models might pose a "catastrophic or existential risk to humanity."

Why this matters to you: Your AI vendor's economics are now public. Before your next multi-year commitment, read the S-1 sections on compute obligations and governance - then ask your other vendors the same questions the SEC now forces Anthropic to answer.

2. Google announces Gemini 4 Carbon - and gates it. On Wednesday, Google DeepMind announced Gemini 4 Carbon, which now ranks first on the Artificial Analysis Intelligence Index v5.0 (score 59). Its cyber results are the story: 88.2% on SEC-bench Pro and new records on exploit benchmarks. Because of that capability, Google is staging the release. The model goes first through US government voluntary pre-release testing and the "Fairwind Program" for cyber defenders. General availability is weeks away.

Why this matters to you: "Announced" no longer means "available." Frontier capability now arrives through staged access programs. Plan your roadmap around access dates, not announcement dates - and get release gates from your vendors in writing.

3. OpenAI takes frontier training offline. The consequences of September's sandbox escape have arrived. OpenAI said this week it will no longer give frontier models live internet access during training. Models train against an "offline world" of indexed and cached web content. OpenAI red-teamed its own infrastructure with its own frontier agents, then patched the container stack it relies on. Anthropic reportedly made a similar move two weeks earlier.

Why this matters to you: Containment has become a competitive feature, not a compliance checkbox. Add one question to every AI procurement: "Describe how you contain your own models." The answers will separate your serious vendors from the rest.

Deep Dive: Context Engineering - 6 Fixes for Agents That Get Dumber as They Work

Here is the uncomfortable truth behind this week's 1M-token context windows: longer context does not mean better answers. Past a point, it means worse ones. The skill of deciding what goes into a model's window - and what stays out - now has a name: context engineering. Drew Breunig's "The State of Context Engineering" talk at AGNTCon this week is the best map of the field so far. This Deep Dive turns it into something you can apply Monday.

First, know the four ways context fails.

Context poisoning: one early error enters the window and compounds through every later step.

Context distraction: the model fixates on its long history instead of its training.

Context confusion: irrelevant tools and documents steer the output.

Context clash: two contradictory facts sit in one window, and the model picks wrong.

Breunig adds two 2026 arrivals: "fighting the weights" (your context argues with what the model already believes) and "context inertia" (a long-running agent cannot change course). If your agent pilots plateau after strong demos, you have met at least one of these.

The fix is a toolkit, not a bigger window. Six moves:

  1. Augmentation (RAG) - retrieve only the information the task needs. Do not paste the whole wiki.
  2. Tool loadout - give the agent only the tools relevant to this task. Thirty tool definitions confuse; five focus.
  3. Quarantine - isolate separate tasks in separate threads or sub-agents. One window, one job.
  4. Pruning - remove stale or irrelevant content before it compounds.
  5. Summarization - compress long histories into short, dense summaries.
  6. Offloading - move state out of the window into files, scratchpads, or databases the agent reads on demand.

The evidence this matters is on your invoice. Retrieval vendors now sell these moves as products - Cohere reports that cutting half of retrieved text kept 96% of answer quality. Less context, same answers, lower cost. Breunig's forward call: memory accumulation and "strategic forgetting" in long-running agents will be the defining context problem of 2027.

Do this on Monday:

  1. Pick your worst-performing agent or assistant workflow. Count what enters its window: instructions, tools, history, retrieved text.
  2. Apply the two cheapest fixes first: cut the tool loadout to five or fewer, and quarantine unrelated tasks into separate threads.
  3. Re-run last week's failed task and compare. Measure quality and token cost. The result usually funds the rest of the toolkit.

Weekly News & Updates

  • OpenAI launches GPT-6.1 Terra at $1 / $5 per million tokens - half the price of GPT-6.1 Sol, and OpenAI's fourth straight price cut. Independent analysis by Max Woolf tracks cuts of up to 80% across major labs since June, with no visible quality drop.

Why it matters: any AI budget you set before summer is stale - re-quote before you renew. (OpenAI)

  • Moonshot's Kimi K3.1 Pro goes open-weight - 1M-token context, full weights due November 4, and 65.7% on Terminal-Bench 4.0, within one point of the leading closed model.

Why it matters: the open-weight gap is now measured in points, not years. (Moonshot AI)

  • Block unveils Dessa, a voice model trained on audio alone - no text, one GB200 rack to train, and it runs faster than real time on a laptop. Early access is limited to safety researchers.

Why it matters: frontier-grade voice no longer needs frontier-grade budgets - expect voice interfaces everywhere in 2027 planning. (Block)

  • Opera ships the first WebAI preview - an early implementation of the proposed web standard, backed by Google and Microsoft, that lets any website call local on-device models.

Why it matters: AI features that run without your API keys - and without your data leaving the device - are becoming a browser default. (Opera)

Favorite Tip of the Week: The 15-Minute Context Reset

Your longest-running chat is your worst-performing one. This week's Deep Dive explains why. Here is the fix, in under 15 minutes.

  1. Open your longest active AI conversation - the one that has started giving vague or repetitive answers.
  2. Paste this prompt: "Summarize this conversation as a handoff note for a new assistant. Include: the goal, the decisions made so far, the constraints I set, the current state of the work, and the single next step. Keep it under 300 words."
  3. Start a brand-new chat. Paste the handoff note as your first message. Continue working there.

You just applied three of the six fixes - summarization, pruning, and quarantine - with one prompt. Make it a habit: new task, new thread, carry only the handoff note.

Potential of AI: Worlds on Demand

The signal this week: Google DeepMind released Genie 4 as a research preview. Type a prompt, get a photorealistic world you can walk through and change while it runs - now with native audio and scenes that stay consistent for two minutes. The detail that matters sits in the fine print: DeepMind used Genie 4 to let a robotics model rehearse tasks in simulation before any real-world trial.

Look one to three years out. Simulation becomes the data factory for physical AI. Robots will do most of their learning inside generated worlds - a million practice runs overnight, zero broken equipment. The companies that win physical AI will not be the ones with the most robots. They will be the ones with the best worlds to train them in. If your business touches logistics, construction, or manufacturing, the question to start asking is: what would we do with a perfect rehearsal space?

The Opportunity… (Open Tech Talks Podcast)

In this episode of Open Tech Talks, host Kashif Manzoor speaks with Daniel C. Rodgers, a former technology leader at Microsoft and Google, author, and financial educator.

show
Who Is in Control When AI Ta...
Nov 1 · OPEN Tech Talks: AI wort...
31:34
Spotify Logo
 
​

Courses to attend:

Events:

  • ADIPEC 2026 (AI, Digital & Technology program) — Abu Dhabi, November 2–5
  • Microsoft AI Tour - Dubai, November 11
  • Global AI Show - Abu Dhabi, November 12–13
  • Dubai Future Week - Dubai, November 18–21
  • AI Future Forum - Dubai, December 1–2
  • GITEX Global - Dubai, December 8–11

Tool / Product Spotlight

Cohere Rerank 5. A reranker sits between your search index and your model. It re-orders retrieved documents so only the most relevant text reaches the context window. Rerank 5 ships in two tiers - Pro at $0.05 and Fast at $0.02 per million tokens - and works over keyword, vector, or hybrid search with no re-indexing. The striking number: with its "Context Focus" trimming, Cohere reports that cutting half the retrieved text kept 96% of answer quality. Scores are calibrated, so 0.7 means a 70% chance the document is useful. Worth testing if you run RAG and your answers got worse as your index grew - this is the Deep Dive's "pruning" fix, sold as a product.

The Investment in AI

Bedrock Robotics raised a $600M Series C at a $4.1B valuation, co-led by CapitalG and Emergence, to scale self-driving excavators across US job sites (TechCrunch). Read the signal, not the amount. Google's growth fund is betting that the next agent wave is physical: machines that do measurable work in industries with measurable labor shortages. The money is moving from agents that chat to agents that dig. If your industry has a "boring machine" layer - trucks, forklifts, scanners, inspection - expect an autonomy pitch on your desk within a year. Decide your evaluation criteria before the pitch arrives.


That's it for this week - thanks for reading! If one idea here helps you, forward this issue to a colleague who makes AI decisions. Hit reply and tell me what you tried - I read every answer.

Until next Saturday,

Kashif

The views expressed here are solely my own, based on my experience, practice, and observation, and do not necessarily represent those of my current or previous employers or their clients and customers.

AI Tech Circle

Learn something new every Saturday about Generative AI #AI #ML #Cloud and #Tech with Weekly Newsletter. Join with 592+ AI Enthusiasts!

Read more from AI Tech Circle

Your Weekly AI Briefing for Leaders Welcome to this week's AI Tech Circle briefing: clear insights on Generative AI that actually matter. This week, four rivals handed their agent building blocks to one neutral foundation. Anthropic, OpenAI, Hugging Face, and Alibaba each donated a core piece of the agent stack to the Linux Foundation's Agentic AI Foundation. This week's Deep Dive turns the standards news into a portability audit you can run on Monday. Today at a Glance: Executive Brief: AI...

show

Your Weekly AI Briefing for Leaders Welcome to this week's AI Tech Circle briefing: clear insights on Generative AI that actually matter. This week, more than forty companies agreed on one thing. They agreed on how an AI agent should knock on a business's front door. Meta and Sierra published the Personal Agent Protocol, and the partner list reads like a payments-and-retail census: Walmart, Stripe, Shopify, Visa, Mastercard, PayPal, Bank of America, OpenAI. I read the draft so you don't have...

show

Your Weekly AI Briefing for Leaders Welcome to this week's AI Tech Circle briefing: clear insights on Generative AI that actually matter. This week, I looked at numbers instead of demos, and two of them stuck with me. Open models now carry more than half the traffic on one major AI gateway, up from 7% last December. And one of the best-funded labs on earth just told the markets it plans to spend over half a trillion dollars on compute in the coming decade. Someone is going to own AI...