BlogJoin the waitlist
Topic · 1 note

Agent readiness

Getting your site ready for AI agents that browse, compare and act on behalf of your customers.

Does Cloudflare's AI crawler block stop Googlebot? It depends on one setting

Since 15 September 2026, Cloudflare sorts crawlers into Search, Training and Agent. Disallow AI Training keeps Googlebot in search; the hard Block setting now stops it, search included. Here is how to tell which one your zone uses.

GEO, Technical SEO, AI crawlers
Find my problem

What does AI say about you?

We ask ChatGPT, Gemini, Google AI Mode and AI Overviews the questions your customers ask, and write down every answer.

The CiteMine audit
One report · four AI platforms · no sales call
Join the waitlist