Insights

The Crawler Logs

Using CloudFront access logs and User-Agent classification, we track how GPTBot, BingBot, ClaudeBot, ChatGPT-User, PerplexityBot, and other LLM bots discover, crawl, and cite GEO-optimized content.

Across 143 days of observation on rozz.genymotion.com, we recorded 46,418 total LLM bot requests and 14,465 citation events.

Citation events represent real users receiving Genymotion content in AI conversations.

Total metrics

• 46,418 Total LLM Bot Requests
• 14,465 Citation Events
• 143 Days of Data
• 14 Log Entries

Log Entries

Entry #14 · May 19, 2026

21 days of clean bot logs.

ChatGPT-User and Claude-User made 1,517 content fetches on Genymotion’s AI site.

Q&As behave as demand-driven answers (61% corpus coverage).

Pages behave as supply-driven source citations (24% coverage).

Q&As also fetched at least one cited source in 79% of Q&A sessions.

• rozz.genymotion.com · Apr 29 – May 19, 2026 · 21 days
• 545 pages + 262 Q&As + 16 topics + 2 runbooks
• Q&A coverage 2.5× higher than pages
• Q&As show a real long tail (top-10 = 41% of fetches)
• 76% of /pages corpus never fetched directly
• Pages get pulled as Q&A source citations
• ClaudeBot: 209 sitemap.xml fetches
• ClaudeBot: 0 llms.txt fetches
• AI-native discovery isn’t the channel yet
• +9.1pp Buyer Share

Entry #13 · May 5, 2026

Three weeks after shipping enterprise content on Genymotion’s AI site, we compared two 14-day windows.

The on-site chatbot’s buyer rate stayed flat (7.2% → 8.1%).

The AI site’s buyer/professional content reads jumped from 35.9% to 45.0%.

Two channels, two audiences.

• rozz.genymotion.com + genymotion.com chatbot · Mar 11–24 vs. Apr 21–May 4, 2026
• 856 ChatGPT-User content reads (14 days)
• Chatbot buyer rate flat at 7–8% across months
• Website still draws hobbyists
• AI site buyer/professional reads: 264 (35.9%) → 385 (45.0%)
• Free-user reads dropped from 39.9% to 31.5%
• Claude-User now 26 hits / 14 days
• Claude-User: 24 from Claude Code
• One 19-fetch procurement pattern in 70 seconds

Entry #12 · Apr 22, 2026

Genymotion’s AI site has 16 topic pages.

In one week of logs, AI platforms asked for 61 more that no longer exist.

The 61 retired topic URLs drew 1,001 requests to retired topic URLs.

Clustering-algorithm iterations kept improving the taxonomy.

The clustering-algorithm iterations broke every external cache that learned the old map.

• rozz.genymotion.com · Apr 15–22, 2026 · 3,484 LLM bot requests this week
• 61 retired topic URLs drew 1,001 requests in 7 days
• ChatGPT-User contributed 387
• Live topic hubs also crawled every week
• LLM systems treat the topic layer as durable structure
• Fix: canonical topics + URL registry + 61 301-redirect mappings to current equivalents
• 2,500+ ChatGPT Sessions

Entry #11 · Apr 14, 2026

People evaluate products through ChatGPT, Claude, and Perplexity now.

The company whose product is being discussed usually has no idea it happened.

667 chatbot conversations and 2,500+ reconstructed ChatGPT sessions show who’s actually asking, what they want, and where the conversations lead.

• rozz.genymotion.com + Genymotion.com chatbot · Mar 1 – Apr 14, 2026
• 3,830 March AI site fetches, 1,323 this week
• Two data sources reveal invisible AI-mediated evaluations
• Chatbot intent on the site
• ChatGPT session reconstruction via CloudFront logs
• 95% of chatbot conversations are hobbyists/individual users
• Enterprise-buyer goals represent <5%
• Not the audience marketing targets
• Reconstructed sessions show live pricing evaluations
• Reconstructed sessions show cross-continent macOS checks
• Reconstructed sessions show recurring VirtualBox bug reports no one else sees

Entry #10 · Apr 8, 2026

Three AI platforms—ChatGPT-User, Claude-User, Perplexity-User—now retrieve content from the same AI site during live user sessions.

9,250 citation requests across 90 days.

Three months ago there were zero.

• rozz.genymotion.com · Jan 8 – Apr 8, 2026 · 22,679 total LLM bot requests (90-day cumulative)
• Perplexity-User first appearance (Apr 5)
• All 3 major citation pipelines now active
• 376 commits across 90 days
• Structural fixes (sitemaps, robots.txt, topic taxonomy) drove every breakthrough
• Q&A pages drive 66–75% of citations
• CLI runbooks open a developer-tool sales channel
• 3 Citation Bots

Entry #9 · Mar 31, 2026

A developer asked Claude Code how much Genymotion costs.

Ten seconds later, Claude Code was showing them how to set it up.

Both answers came from our AI site.

14 Claude-User requests in 6 days.

12 requests came from Claude Code.

• rozz.genymotion.com · Mar 24–31, 2026 · 1,612 total LLM bot requests
• Claude-User: first-ever appearance
• Claude-User: 14 requests
• Claude-User: 12 from Claude Code terminal sessions
• 10 seconds from pricing Q&A to CLI runbook
• Evaluation and implementation in one session
• Claude pipeline complete: ClaudeBot crawl → 5 days → Claude-User live retrieval
• 14 Claude-User

Entry #8 · Mar 24, 2026

ClaudeBot made 958 requests in one week.

ClaudeBot made 958 requests up from 123 the week before.

503 GEO pages and 162 Q&A pages were crawled.

ClaudeBot crawl was the largest since December.

Six hours after deploying per-topic sitemaps, ClaudeBot came back.

• rozz.genymotion.com · Mar 17–24, 2026 · 2,446 total LLM bot requests
• ClaudeBot 8x increase (123 → 958) triggered the day per-topic sitemapindex was deployed
• March 20: 577 ClaudeBot requests in a single day
• Largest since December
• Every major AI crawler has now completed a deep indexing event on the AI site
• 8x ClaudeBot

Entry #7 · Mar 17, 2026

PerplexityBot made 511 requests in one week.

PerplexityBot made 511 requests up from 42 the week before.

PerplexityBot crawled 172 Q&A pages and 256 GEO pages.

PerplexityBot made more content in 7 days than in its entire prior history on the site combined.

• rozz.genymotion.com · Mar 10–17, 2026 · 2,532 total LLM bot requests
• PerplexityBot 12x increase (42 → 511) triggered the day after index page redesign
• 84% of PerplexityBot requests hit content pages
• PerplexityBot hit content pages: Q&A and GEO pages
• PerplexityBot made no homepage crawls
• ClaudeBot: 0 Q&A pages
• ClaudeBot: 0 Claude-SearchBot traffic
• ClaudeBot remained in discovery mode after 3 weeks
• 12x PerplexityBot

Entry #6 · Mar 10, 2026

ChatGPT-User made 681 visits in one week.

By grouping visits into sessions using IP hashes and timing, we reconstructed 168 sessions.

The 168 sessions show how users navigate AI-mediated discovery.

• rozz.genymotion.com · Mar 3–10, 2026 · 681 ChatGPT-User visits
• 4.6 pages fetched per turn
• ChatGPT-User verifies across multiple sources, not just one
• 28% of sessions hit only the index page and stopped
• Index redesign led to the sessions stopping early
• 30% of sessions are multi-turn
• Multi-turn sessions allow reconstruction of actual ChatGPT conversations
• 168 Sessions

Entry #5 · Mar 3, 2026

We tested 24 queries across four AI platforms.

ChatGPT cites Genymotion 83% of the time.

Claude cites Genymotion 21% of the time.

Perplexity cites Genymotion 17% of the time.

Gemini cites Genymotion 4% of the time.

The first three track with crawl volume.

Gemini doesn’t crawl the AI site at all.

• rozz.genymotion.com · Feb 24 – Mar 3, 2026 · 24 queries × 4 platforms
• ChatGPT: 83% citation rate
• ChatGPT: up from 14% before the AI site launched
• ClaudeBot jumped 24x (21 to 505 requests)
• ClaudeBot reads topic taxonomy, not individual pages
• Gemini recommends Genymotion in most queries but doesn’t link
• Gemini doesn’t link due to a different pipeline entirely
• 83% Citation Rate

Entry #4 · Feb 24, 2026

BingBot made 1,556 requests this week.

BingBot made more requests than any other bot, including ChatGPT-User.

What started as a ChatGPT story is now happening across six platforms.

• rozz.genymotion.com · Feb 17–24, 2026 · 3,188 total requests
• BingBot: 1,556 requests
• BingBot: largest single bot category
• BingBot: surpassing ChatGPT-User
• ChatGPT-User citations: 1,329
• ChatGPT-User citations: up from 1,077 the prior week (+23%)
• Six platforms now crawling
• OpenAI
• Microsoft
• Anthropic
• Meta
• ByteDance
• Perplexity
• 3x WoW Growth

Entry #3 · Feb 17, 2026

ChatGPT citations hit 1,077 this week.

ChatGPT citations were 3x the 345 reported last week.

The six-week trajectory was 42 → 345 → 1,077.

Q&A pages drive 66% of all citations.

• rozz.genymotion.com · Feb 10–17, 2026 · 2,606 total requests
• 1,077 ChatGPT citations in 7 days
• 1,077 ChatGPT citations: 3x the previous week's 345
• Q&A pages remain the citation driver
• Q&A pages drive 66% of all ChatGPT requests
• PerplexityBot activity up 5x
• PerplexityBot: 33 requests vs 7 the previous week
• 16x Citation Growth

Entry #2 · Feb 10, 2026

ChatGPT citations grew from 7 to 116 in one week.

345 citation events were recorded.

161 unique sessions were reconstructed.

75% of requests hit Q&A pages.

Not traditional content.

• rozz.genymotion.com · Feb 2–9, 2026 · 2,195 total requests
• 16x daily citation growth
• 16x daily citation growth: from 7 on Feb 2 to 116 on Feb 9
• 75% of ChatGPT requests landed on Q&A pages
• Q&A pages are not traditional content
• Q&A pages cited 10x more than traditional GEO content pages
• 547 Requests / Day

Entry #1 · Feb 3, 2026

GPTBot made 547 requests in a single day.

GPTBot made 547 requests that were 47% of all training bot activity in 30 days.

Three weeks later, ChatGPT users were receiving content in their conversations.

• rozz.genymotion.com · Jan 3–Feb 2, 2026 · 1,280 total requests
• GPTBot made 547 requests on January 7
• GPTBot: 547 requests were 47% of 30-day training activity in one day
• 42 citation events recorded
• Citation events were concentrated on high-intent pages
• High-intent pages include requirements and compatibility
• ~3 weeks from major crawl to first ChatGPT citations
• 547 Requests in One Day

Methodology

Bot classification is based on User-Agent strings.

Training bots (GPTBot, ClaudeBot) are distinguished from index bots (OAI-SearchBot).

Citation events are distinguished as ChatGPT-User.

Citation events represent real user conversations where ChatGPT retrieved and cited mirror site content.

All data is from a single production mirror site.

Results may vary by domain, content volume, and vertical.

Get Your Own Crawler Logs

ROZZ builds mirror sites with full CloudFront logging.

See exactly which AI bots crawl your content, when they crawl it, and when citations begin.

$997 /month | Mirror site + crawler analytics

→ Book a call

→ See how it works

→ rozz@rozz.site