Cloudflare updates “robots.txt” — what does that mean for the future of the web?
Cloudflare has introduced its Content Signals Policy, expanding robots.txt with new rules that let publishers control whether their content is used for search, AI answers, or AI training.