techยท

Tech Subtext - September 16, 2026

The web just changed its default. Bots that read for AI now get blocked on the pages that pay the bills.

The web just changed its default. Bots that read for AI now get blocked on the pages that pay the bills.


THE DEFAULT JUST FLIPPED

The open web quietly changed who gets to read it

I refreshed a Cloudflare dashboard this morning and the setting had moved on its own.

Starting today, September 15, the crawlers that scrape pages to feed AI get blocked by default on any page that shows ads.

Cloudflare sits in front of a huge slice of the internet. When it changes a default, the default changes for a big chunk of the web at once.

This is small in the settings menu and huge in what it means. The plumbing of who reads the web just got rewritten.

The Signal

Today points one direction: open beats locked, and access is the new battleground.

Cloudflare gates AI readers. Cornelis raises to crack open Nvidia's closed network. Google quietly lets its own engineers use a rival's AI. The fight moved from who builds the smartest model to who controls the pipes, the pages, and the tools around it.

Across the Industry

๐Ÿ•ท๏ธ Cloudflare blocks AI training bots by default today

The change went live September 15. Cloudflare split AI crawlers into three buckets: Search, Agent, and Training. On pages that show ads, Training and Agent now get blocked by default, while Search stays allowed.

A crawler, plain version: a bot that visits web pages and copies what it finds. Some copy to help you find pages in search. Others copy to train AI or answer questions inside a chatbot.

Why this matters: publishers wanted to stay in search but stop feeding AI answers for free. The catch is that Google, Apple, and Microsoft run bots that do both jobs at once. Block one and you may lose the other. That is the trap this is trying to spring.

๐Ÿค Google lets its own engineers use Claude

Google broke a quiet rule this week. It now lets engineers across the company use Anthropic's Claude Opus 5, through its internal tool called Antigravity, with per-person limits.

Until now, staff were pushed to use Gemini, Google's own model. Outside coding tools like Claude were mostly off-limits.

Why this matters: this is Coke handing out Pepsi. Google put up to $40 billion into Anthropic, and Gemini still lags on coding. Letting your own people reach for a rival's tool is the loudest way to admit yours isn't winning the task that matters most to engineers.

๐Ÿ”Œ Cornelis raises $205M to open up Nvidia's network

Cornelis Networks, an Intel spinoff, raised $205 million and launched something called Active Compute Fabric. It also teamed up with Qualcomm.

Here's the problem it targets. In big AI clusters, expensive chips sit idle waiting for data to arrive. Cornelis wants the network itself to do some of the work, so chips process and send at the same time.

Why this matters: Nvidia's network, NVLink and InfiniBand, is fast but closed. You buy Nvidia, you stay Nvidia. Cornelis sells an open version that works with any chip. The network is only about 15% of an AI system's cost, but it decides how much you get from the other 85%.

๐ŸŽฎ Nvidia turns its gaming flagship into an AI card

Nvidia took its top gaming card, the RTX 5090, stuffed it with memory, and relaunched it for AI work as the RTX Pro 5500.

Same core silicon. But 84GB of memory, 2.6 times what the gaming version carries. Bigger memory means bigger AI models fit on one card.

Why this matters: this is where the money went. The gaming 5090 has been near impossible to buy at list price for months. Nvidia would rather sell the same chip with more memory to AI buyers at fatter margins. Gamers are watching their flagship quietly get repurposed for the boom.

๐Ÿชช Revolut hands crypto figures' IDs to a fake government email

Revolut confirmed a data leak that hit around 680 customers. No system was hacked. A fraudster used a real government email domain to send fake requests, and Revolut handed over the records.

The stolen files include passports, selfies, addresses, and full transaction history, including Bitcoin activity. Crypto figures were among the targets. A group demanded 10,000 Bitcoin, roughly $780 million.

Why this matters: this is the scary kind of breach. Nobody broke the locks. A trusted process got tricked. And when a passport scan sits next to a wallet, a person's crypto and their home address stop being separate secrets.

The Numbers

$205M โ€” Cornelis Networks raise

Led by IAG Capital Partners, plus a Qualcomm tie-up, to build an open network that rivals Nvidia's closed stack.

10,000 BTC โ€” Revolut ransom demand

Roughly $780 million. Around 680 customers had IDs and crypto history exposed after a fake government email request.

84GB โ€” RTX Pro 5500 memory

2.6 times the gaming RTX 5090's memory, on the same die. Nvidia chasing AI margins over gamers.

The Main Event

The AI wars moved to the pipes, not the models

For two years the story was the model. Whose AI is smartest. Whose benchmark won this week.

Today tells a different story. The fight is now about access and control of the layers around the model.

Start with Cloudflare. Its new default treats reading the web as a permission, not a right. Bots that scrape to train AI get shut out of ad pages unless they declare what they're doing. Cloudflare says bots have already overtaken humans as most web traffic. So it's charging a toll and picking sides for the people who make the pages.

Now look at Cornelis. Nvidia's grip isn't just the chip. It's the closed network that locks you into buying more Nvidia. Cornelis raised $205 million to sell an open version. Qualcomm stood on stage with them. That's not a product launch. That's a coalition forming against a moat.

And then Google. It quietly let its own engineers reach for Claude instead of Gemini. When a company that spent $40 billion on a rival still hands its people that rival's tool, the tell is loud. The model layer is a commodity now. What matters is the tool wrapped around it and who controls the quota.

See the pattern. Cloudflare controls the pages. Cornelis wants to open the network. Google is choosing tools over pride. Each is a fight over a layer, not the model.

The smartest model stopped being the whole game. The web is being carved into who reads what, who connects to what, and who gets to build on top. That's the real map of power now.

My take: watch the pipes, not the leaderboards. The next winners aren't the ones with the best benchmark. They're the ones who own the layer everyone else has to pay to cross.

The Subtext Report

The slowdown that saves everyone money

Amodei, Altman, Musk, and Hassabis all backed a call to slow the AI race over the weekend. Very noble.

Also convenient. Altman ruled out a 2026 IPO days earlier and pointed to safety. A slowdown lowers the crushing bill for the next round of compute and makes today's AI assets more valuable. Michael Burry reportedly smelled pre-IPO theater. When the people racing hardest suddenly ask for a speed limit, check whose gas tank is empty.

Coke ships you a Pepsi

Google spent up to $40 billion on Anthropic and told its engineers to use Gemini. This week it let them use Claude instead.

The official line is that Gemini stays the 'primary and foundational' model. Sure. You just handed your builders a competitor's tool for the one job they do all day. That's not a complement. That's a scoreboard, and everyone can read it.


Now that the majority of traffic on the Internet is non-human, we must go further and act faster so that a sustainable ecosystem can emerge.

โ€” Matthew Prince, Cloudflare CEO

Newsletter

Stay updated with new articles.

Newsletter

Stay updated with new articles.

Copyright ยฉ 2026 ยท Tech Subtext Powered by Writizzy