Merom.ai

Cloudflare has launched a new feature to block AI bots, scrapers, and crawlers with a single click, and it's free. As AI crawlers continue to swallow up web content, this tool helps protect your content from being used without consent. Many AI crawlers ignore robots txt exclusions or spoof their user agents. Up until now, the robots.txt file has been fairly reliable in helping control bots, but data shows that AI bots don't seem to honor that system. Why Use This? 🤖 Prevent unauthorised use of your data for AI training. 🤖 Reduce maintenance of robots txt file. 🤖 Automatically blocks new bots identified by Cloudflare. Top AI Bots Seen on Cloudflare: 🕷 Bytespider - TikTok (40.4% of sites accessed) 🕷 GPTBot - OpenAI (35.46% of sites accessed) 🕷 ClaudeBot - Anthropic (11.17% of sites accessed) Not all websites will want to block AI bots and crawlers, but for those who do, this is an easy one-click solution with little maintenance required.