How to Whitelist Rozzbot in Cloudflare?

Direct Answer

Rozzbot can be whitelisted in Cloudflare.

This is done by creating a custom firewall rule in the Web Application Firewall (WAF) settings that allows traffic from the user agent Rozzbot.

Detailed Explanation

This section explains Rozzbot and the steps to whitelist Rozzbot in Cloudflare.

Why Whitelist Rozzbot?

Rozzbot follows your website’s robots.txt file, respecting your preferences on which content can and cannot be accessed.

Rozzbot does not scrape unlicensed content for AI training or model development.

Rozzbot provides insights after each crawl about issues found in your content, such as broken links and duplicates.

How to Whitelist Rozzbot in Cloudflare

Create a custom rule in Cloudflare’s Web Application Firewall (WAF) using the steps below:

1. In your Cloudflare dashboard, click on Security in the main menu.

2. Under Security, click on WAF to access your firewall settings.

3. Click Firewall Rules and Select Create a Firewall Rule.

4. Enter a name for the rule, such as “Allow Rozzbot.”

5. Set Field to User Agent from the dropdown.

6. Set Operator to Equals.

7. Set Value to Rozzbot.

8. Set “Then…” to “Allow”.

9. Click Deploy.

That is it.

Research Foundation

This answer synthesizes findings from 35+ peer-reviewed research papers on GEO, RAG systems, and LLM citation behavior.

Related Topics

Author

Adrien Schmidt, Co-Founder & CEO, ROZZ

Former AI Product Manager with 10+ years experience building AI systems including Aristotle (conversational AI analytics) and products for eBay and Cartier.

rozz@rozz.site