28d • General Discussions 💬
Cloudflare could keep LLMs.txt from working (without changes)
AI Agency users should be aware that Cloudflare has taken (IMO) a pretty aggressive stance against AI bot traffic, and is now by default blocking access to AI summary crawlers. If you use Cloudflare, you should take a look at your site settings to make sure those crawls that you're expecting are really happening. That is all.
1
5 comments
Cloudflare could keep LLMs.txt from working (without changes)
skool.com/reviewlyai
AI-powered training, white-label SaaS, and growth strategies to help you launch and scale your agency—fast. Sponsored by Reviewly.ai.
Leaderboard (30-day)
1
🔥
+36
2
+35
3
+13
4
+12
5
+11
Powered by