:

CLOUDFLARE REPLACES AI BOT BAN WITH GRANULAR CONTROLS

AI DESK1 MIN READ
MON, JUL 6, 2026

■ AI-SUMMARIZED FROM 1 SOURCE ▸ TIMELINE

Cloudflare is rolling out granular AI bot management tools that let site owners control Search, Training, and Agent crawlers independently instead of blocking them all at once. Starting September 15, 2026, Training and Agent bots will be blocked by default on ad-supported pages.

The shift moves away from Cloudflare's previous blanket approach to AI bot blocking. Site owners now gain flexibility to allow search engine crawlers while restricting training and agent bots—or manage each category according to their specific needs. The September 2026 default settings represent a middle ground for ad-supported sites, where Training and Agent bots will be automatically blocked unless explicitly permitted. This addresses growing concerns about AI companies scraping content without permission while maintaining access for search indexing. Cloudflare's granular controls apply to all customers, not just enterprise accounts, expanding access to bot management tools across its user base. The change reflects broader industry pressure to balance AI development with content creators' rights and site owners' control over their data.

■ SOURCES

The Decoder

■ SUMMARY WRITTEN BY AI FROM THE LINKS ABOVE

■ MORE FROM THE AI DESK

AI chatbots successfully challenged or refused to engage with over 90% of false narratives from Russia, China, and Iran, while Google's AI overviews stopped only 60% of the same claims, according to NPR analysis.

JUST NOWAI Desk

Caterpillar is leveraging decades of experience deploying autonomous equipment in remote mining operations to guide its artificial intelligence strategy. The industrial equipment manufacturer plans to use lessons learned from automating heavy machinery to accelerate responsible AI deployment.

4H AGOAI Desk

Employee reviews on Glassdoor reveal a sharp decline in positive sentiment toward AI, with favorable comments falling from 81 percent in 2019 to 43 percent today. The shift reflects widening concerns among frontline workers, particularly in sectors like insurance claims.

5H AGOAI Desk

AI researcher Ajeya Cotra characterizes a recent OpenAI/Hugging Face incident as more than 50% of the way toward a full-blown AI takeover scenario. Cotra warns this may be the last major warning shot before AI systems advance beyond human control.

8H AGOAI Desk

■ SUBSCRIBE TO THE DAILY BRIEF

ONE EMAIL, 5 STORIES, 06:00 UTC. UNSUBSCRIBE ANYTIME.