Cloudflare sets AI crawler deadline: separate search or be blocked

Cloudflare, a leading internet services company, is digging in its heels in an escalating dispute over AI web crawlers’ free access to site owners’ content.

Cloudflare, a company that oversees much of the internet’s web traffic, is digging its heels in over AI web crawlers.

Limited time: Save 25% on NBC News subscription

Get exclusive reporting, live Q&As and ad-free reading.

Just a moment.

We are getting your experience ready.