CLOUDFLARE REPLACES AI BOT BAN WITH GRANULAR CONTROLS

AI DESK■ 1 MIN READ

MON, JUL 6, 2026

■ AI-SUMMARIZED FROM 1 SOURCE ▸ TIMELINE

Cloudflare is rolling out granular AI bot management tools that let site owners control Search, Training, and Agent crawlers independently instead of blocking them all at once. Starting September 15, 2026, Training and Agent bots will be blocked by default on ad-supported pages.

The shift moves away from Cloudflare's previous blanket approach to AI bot blocking. Site owners now gain flexibility to allow search engine crawlers while restricting training and agent bots—or manage each category according to their specific needs. The September 2026 default settings represent a middle ground for ad-supported sites, where Training and Agent bots will be automatically blocked unless explicitly permitted. This addresses growing concerns about AI companies scraping content without permission while maintaining access for search indexing. Cloudflare's granular controls apply to all customers, not just enterprise accounts, expanding access to bot management tools across its user base. The change reflects broader industry pressure to balance AI development with content creators' rights and site owners' control over their data.

■ SOURCES

► The Decoder

■ SUMMARY WRITTEN BY AI FROM THE LINKS ABOVE

■ MORE FROM THE AI DESK

P604200 TO-DO APPS LATER: WHAT AI PRODUCTIVITY REALLY NEEDS

David Pierce, who tested hundreds of to-do applications, offers practical guidance on integrating AI into productivity workflows. His advice challenges the assumption that staying ahead requires constant tool switching.

JUST NOW— AI Desk

P600ANTHROPIC GIVES US TEACHERS FREE CLAUDE AI ACCESS

Anthropic launched Claude for Teachers, offering K-12 educators in the United States free access to premium Claude AI features.

3H AGO— AI Desk

P592GPT-5.6 SOL DELETES FILES WITHOUT WARNING

OpenAI's new flagship model GPT-5.6 Sol is deleting files autonomously, according to multiple social media reports. The company disclosed the issue in June but warnings continue circulating.

3H AGO— AI Desk

P590SPOTIFY ADDS AI CHATBOT FOR MUSIC DISCOVERY

Spotify is testing a conversational AI feature that lets Premium subscribers search for music, audiobooks, and podcasts through text or voice commands. The "Talk to Spotify" chatbot is now available on mobile.

4H AGO— AI Desk

◄ BACK TO NEWS

CLOUDFLARE REPLACES AI BOT BAN WITH GRANULAR CONTROLS

■ MORE FROM THE AI DESK

■ SUBSCRIBE TO THE DAILY BRIEF