AI Bot Visibility Report

Paste Nginx combined logs or Cloudflare JSONL to see which recognizable AI bots actually appeared in your access logs.

Import log file

Target website

Advanced: external crawler simulator

Generate marked requests, then use imported logs to decide which attempts were observed.

External AI crawler simulator

Run the simulator against the website you enter, then compare the attempted crawl requests with the logs you paste or import below.

Website URL

Simulated crawl attempts

These are generated requests only. They are not proof that an AI company visited the site.

Run the simulator to see attempted requests.

Observed in imported logs

This comparison marks which simulated attempts also appear in the access logs currently pasted here.

Run the simulator to see attempted requests.

Paste or import access logs

203.0.113.10 - - [08/Jul/2026:09:10:11 +0800] "GET /llms.txt HTTP/1.1" 200 342 "-" "GPTBot/1.0"
203.0.113.11 - - [08/Jul/2026:09:12:11 +0800] "GET /articles/open-geo-console HTTP/1.1" 200 912 "-" "OAI-SearchBot/1.0"
203.0.113.15 - - [08/Jul/2026:10:01:17 +0800] "GET /pricing HTTP/1.1" 404 231 "-" "ChatGPT-User/1.0"
203.0.113.12 - - [08/Jul/2026:09:14:11 +0800] "GET /about HTTP/1.1" 200 1204 "-" "Claude-SearchBot"
203.0.113.16 - - [09/Jul/2026:08:05:29 +0800] "GET /case-studies HTTP/1.1" 200 1888 "-" "Perplexity-User/1.0"
203.0.113.13 - - [09/Jul/2026:08:15:11 +0800] "GET / HTTP/1.1" 200 2232 "-" "Bytespider"
203.0.113.17 - - [09/Jul/2026:08:18:40 +0800] "GET /blog/geo-readiness HTTP/1.1" 301 0 "-" "CCBot/2.0 (https://commoncrawl.org/faq/)"
198.51.100.20 - - [09/Jul/2026:08:20:03 +0800] "GET /contact HTTP/1.1" 200 1780 "https://example.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0 Safari/537.36"
203.0.113.14 - - [10/Jul/2026:09:16:11 +0800] "GET /projects HTTP/1.1" 200 2032 "-" "PerplexityBot"
{"EdgeStartTimestamp":"2026-07-10T01:20:11Z","ClientRequestMethod":"GET","ClientRequestPath":"/sitemap.xml","EdgeResponseStatus":200,"ClientRequestUserAgent":"ClaudeBot"}
{"EdgeStartTimestamp":"2026-07-10T01:24:33Z","ClientRequestMethod":"GET","ClientRequestPath":"/robots.txt","EdgeResponseStatus":200,"ClientRequestUserAgent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/18.0 Safari/605.1.15"}

Summary

9 of 19 registry entries were detected from log evidence.

Lines: 11
Parsed: 11
AI hits: 9
Detected bots: 9
Operators: 5
Registry bots: 19

Operator summary

OpenAI

ChatGPT-User, GPTBot, OAI-SearchBot

3 hits

Jul 8, 2026, 2:01 AM

Anthropic

Claude-SearchBot, ClaudeBot

2 hits

Jul 10, 2026, 1:20 AM

Perplexity

Perplexity-User, PerplexityBot

2 hits

Jul 10, 2026, 1:16 AM

ByteDance

Bytespider

1 hits

Jul 9, 2026, 12:15 AM

Common Crawl

CCBot

1 hits

Jul 9, 2026, 12:18 AM

Detected bots

GPTBot

OpenAI · Training

Log-detectable

Detected

Jul 8, 2026, 1:10 AM

OAI-SearchBot

OpenAI · Search

Log-detectable

Detected

Jul 8, 2026, 1:12 AM

ChatGPT-User

OpenAI · Assistant fetch

Log-detectable

Detected

Jul 8, 2026, 2:01 AM

ClaudeBot

Anthropic · Training

Log-detectable

Detected

Jul 10, 2026, 1:20 AM

Claude-SearchBot

Anthropic · Search

Log-detectable

Detected

Jul 8, 2026, 1:14 AM

PerplexityBot

Perplexity · Search

Log-detectable

Detected

Jul 10, 2026, 1:16 AM

Perplexity-User

Perplexity · Assistant fetch

Log-detectable

Detected

Jul 9, 2026, 12:05 AM

Bytespider

ByteDance · Training

Suspected / community

Detected

Jul 9, 2026, 12:15 AM

CCBot

Common Crawl · Training

Log-detectable

Detected

Jul 9, 2026, 12:18 AM

AI Bot Coverage Matrix

Robots-token-only entries are policy controls for robots.txt. They are not proof that a crawler visited the site.

Claude-SearchBot

Anthropic · Search

Log-detectable

Detected

Jul 8, 2026, 1:14 AM

ClaudeBot

Anthropic · Training

Log-detectable

Detected

Jul 10, 2026, 1:20 AM

Bytespider

ByteDance · Training

Suspected / community

Detected

Jul 9, 2026, 12:15 AM

CCBot

Common Crawl · Training

Log-detectable

Detected

Jul 9, 2026, 12:18 AM

ChatGPT-User

OpenAI · Assistant fetch

Log-detectable

Detected

Jul 8, 2026, 2:01 AM

GPTBot

OpenAI · Training

Log-detectable

Detected

Jul 8, 2026, 1:10 AM

OAI-SearchBot

OpenAI · Search

Log-detectable

Detected

Jul 8, 2026, 1:12 AM

Perplexity-User

Perplexity · Assistant fetch

Log-detectable

Detected

Jul 9, 2026, 12:05 AM

PerplexityBot

Perplexity · Search

Log-detectable

Detected

Jul 10, 2026, 1:16 AM

Amazonbot

Amazon · General crawl

Log-detectable

Not seen

0 hits

Page 1 of 2

Detected path evidence

AnthropicClaude-SearchBot/about1

AnthropicClaudeBot/sitemap.xml1

ByteDanceBytespider/1

Common CrawlCCBot/blog/geo-readiness1

OpenAIGPTBot/llms.txt1

OpenAIOAI-SearchBot/articles/open-geo-console1

OpenAIChatGPT-User/pricing1

PerplexityPerplexity-User/case-studies1

PerplexityPerplexityBot/projects1

Policy and evidence notes

Google-Extended is controlled through the robots.txt token Google-Extended; show it as policy, not traffic evidence.

Microsoft Copilot is marked as suspected or community-observed. Treat hits as visibility signals and verify the source before reporting a definitive claim.

Bytespider is marked as suspected or community-observed. Treat hits as visibility signals and verify the source before reporting a definitive claim.

Applebot-Extended is controlled through the robots.txt token Applebot-Extended; show it as policy, not traffic evidence.

Recommended Nginx logging

Use this Nginx log format to keep User-Agent evidence for future reports.

log_format geo_console '$remote_addr - $remote_user [$time_local] "$request" '
  '$status $body_bytes_sent "$http_referer" "$http_user_agent"';