Cloudflare’s AI Crawler Rules Can Block Googlebot via @sejournal, @MattGSouthern
via searchenginejournal.com
Short excerpt below. Read at the original source.
Cloudflare now lets all sites manage AI crawlers as Search, Agent, or Training, with Sept. 15 defaults that can block Googlebot for sites blocking training. The post Cloudflare’s AI Crawler Rules Can Block Googlebot appeared first on Search Engine Journal.