The Crawler Logs
The Crawler Logs document real AI crawler behavior on production AI sites built by ROZZ.
CloudFront access logs and User-Agent classification are used to track how GPTBot, BingBot, ClaudeBot, ChatGPT-User, PerplexityBot, and other LLM bots discover, crawl, and cite GEO-optimized content.
Across 59 days of observation on rozz.genymotion.com, 11,044 total LLM bot requests were recorded.
4,021 citation events were recorded.
Real users received Genymotion content in AI conversations.
Log Entries
Entry #5 · Mar 3, 2026
- The platforms that crawl your AI site the most cite you the most (except one).
- rozz.genymotion.com · Feb 24 – Mar 3, 2026 · 24 queries × 4 platforms
- ChatGPT cites Genymotion 83% of the time.
- This rate is up from 14% before the AI site launched.
- ClaudeBot jumped 24x (21 to 505 requests).
- ClaudeBot reads topic taxonomy, not individual pages.
- Gemini doesn’t crawl the AI site at all.
Entry #4 · Feb 24, 2026
- Bing just found Genymotion: 1,556 BingBot requests and what it means.
- BingBot made 1,556 requests this week—more than any other bot, including ChatGPT-User.
- What started as a ChatGPT story is now happening across six platforms.
- Six platforms now crawling: OpenAI, Microsoft, Anthropic, Meta, ByteDance, Perplexity.
Entry #3 · Feb 17, 2026
- 3x Week-Over-Week: What Sustained ChatGPT Citation Growth Looks Like.
- ChatGPT citations hit 1,077 this week, 3x the 345 reported last week.
- Six-week trajectory: 42 → 345 → 1,077.
- Q&A pages drive 66% of all citations.
- rozz.genymotion.com · Feb 10–17, 2026 · 2,606 total requests.
- 1,077 ChatGPT citations in 7 days—3x the previous week's 345.
- Q&A pages remain the citation driver: 66% of all ChatGPT requests.
- PerplexityBot activity up 5x: 33 requests vs 7 the previous week.
Entry #2 · Feb 10, 2026
- 16x Citation Growth in 7 Days: What ChatGPT Users Are Actually Asking.
- ChatGPT citations grew from 7 to 116 in one week.
- 345 citation events, 161 unique sessions, and 75% of requests hitting Q&A pages—not traditional content.
- rozz.genymotion.com · Feb 2–9, 2026 · 2,195 total requests.
- 16x daily citation growth: from 7 on Feb 2 to 116 on Feb 9.
- 75% of ChatGPT requests landed on Q&A pages, not traditional content.
- Q&A pages cited 10x more than traditional GEO content pages.
Entry #1 · Feb 3, 2026
- 547 Requests in One Day: What Happens When GPTBot Discovers Your Mirror Site.
- GPTBot made 547 requests in a single day—47% of all training bot activity in 30 days.
- Three weeks later, ChatGPT users were receiving content in their conversations.
- rozz.genymotion.com · Jan 3–Feb 2, 2026 · 1,280 total requests.
- GPTBot made 547 requests on January 7—47% of 30-day training activity in one day.
- 42 citation events recorded; concentrated on high-intent pages (requirements, compatibility).
- ~3 weeks from major crawl to first ChatGPT citations.
Methodology
- Data source: CloudFront access logs for rozz.genymotion.com.
- Bot classification based on User-Agent strings.
- Training bots (GPTBot, ClaudeBot) are distinguished from search index bots (OAI-SearchBot) and citation events (ChatGPT-User).
- Citation events represent real user conversations where ChatGPT retrieved and cited mirror site content.
- All data is from a single production mirror site; results may vary by domain, content volume, and vertical.
Get Your Own Crawler Logs
- ROZZ builds mirror sites with full CloudFront logging.
- See exactly which AI bots crawl your content, when they crawl it, and when citations begin.
- $997/month | Mirror site + crawler analytics
- Book a call → See how it works → rozz@rozz.site
Author
- Adrien Schmidt, CEO, ROZZ.
- Adrien Schmidt is a serial tech entrepreneur with 10+ years experience building AI systems including Aristotle (conversational AI analytics) and products for eBay and Cartier.