See which AI bots crawl your site

Drop in your server access log to see how often ChatGPT, Claude, Perplexity and other AI crawlers visit, which pages they read, the errors they hit, and which "bots" are fakes. Your log is analyzed in your browser and never uploaded.

Drop your access log here

Apache, Nginx, IIS, Cloudflare and other JSON logs. .gz files and several files at once work too.

Your log never leaves your browser. It's read on your device; we only send you the public IP lists that AI companies publish for their crawlers.

What this tool checks

  • Every request from 26 AI crawlers and search bots, including GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, PerplexityBot, Meta-ExternalAgent, Bytespider, CCBot, Googlebot and Bingbot
  • Fake bots: requests using a bot's name from an IP address outside the ranges OpenAI, Perplexity, Google, Microsoft, Apple, Common Crawl, DuckDuckGo and Mistral publish
  • Which pages each bot reads most, and AI bot requests per day
  • Errors served to bots, including 403 and 429 refusals from firewalls and rate limits
  • Popular pages that no AI search or assistant bot fetched
  • Apache and Nginx (combined), IIS (W3C) and JSON logs from Cloudflare, Vercel, Netlify and others, including .gz files

Why your server log is the only real answer

Analytics tools like Google Analytics run JavaScript, and AI crawlers don't. Your server's access log is the only record of every time GPTBot, ClaudeBot or PerplexityBot fetched a page, which pages they read, and whether they got a page or an error.

Not every bot matters in the same way. Training bots (GPTBot, ClaudeBot, CCBot) collect content for future models. Search bots (OAI-SearchBot, Claude-SearchBot, PerplexityBot) index pages so assistants can cite them. User-request bots (ChatGPT-User, Claude-User, Perplexity-User) fetch a page live because someone asked an assistant about it, which makes them the closest thing to an AI referral you can see in a log.

Anyone can put "GPTBot" in a user agent. Scrapers and vulnerability scanners do it to get past bot filters. Several AI companies publish the IP ranges their crawlers use, so this tool checks each request against those lists and separates the real bots from the impostors. Anthropic, Meta, ByteDance and Amazon don't publish lists, so their bots are shown but can't be verified.

Frequently asked questions

Is my log file uploaded anywhere?

No. The file is read and analyzed in your browser with JavaScript. The only thing your browser downloads from us is the public list of AI crawler IP ranges, so you can even disconnect after the page loads.

Where do I find my access log?

On cPanel hosting, open Metrics → Raw Access and download the log. On a server running Nginx it's usually /var/log/nginx/access.log, and for Apache /var/log/apache2/access.log or /var/log/httpd/access_log. On Cloudflare, use Logpush (Enterprise) or Instant Logs; on Vercel and Netlify, use a log drain. Hosts like Wix and Squarespace don't give access to raw logs.

How do I know if ChatGPT visits my website?

Look for three user agents in your log: OAI-SearchBot (indexes pages for ChatGPT search), ChatGPT-User (fetches a page when a user asks about it) and GPTBot (collects training data). This tool counts each one and checks that the requests come from OpenAI's published IP addresses.

What is a fake or spoofed bot?

A request that claims to be a well-known crawler, such as GPTBot or Googlebot, but comes from an IP address the company doesn't use. Blocking those IPs is safe and doesn't affect the real crawler.

Should I block AI bots?

Blocking training bots like GPTBot or CCBot keeps your content out of future models and doesn't remove you from AI answers. Blocking search and user-request bots like OAI-SearchBot, ChatGPT-User or PerplexityBot does: assistants can't cite a page they can't read.

Why isn't Google-Extended in my log?

Google-Extended is only a robots.txt token that tells Google whether Gemini may use your content. Google doesn't crawl with a separate Google-Extended user agent; the fetching is done by Googlebot.

More free SEO tools

  • AI Crawler CheckerFree check: can ChatGPT, Claude, Perplexity and Gemini crawlers reach your site? Tests robots.txt rules per AI bot, firewall and CDN blocks, and llms.txt..
  • Meta Tag CheckerCheck any page's title tag, meta description, canonical, Open Graph and Twitter Card tags.
  • Robots.txt CheckerFetch and test any site's robots.txt.
  • Schema Markup CheckerSee which schema.org structured data a page has (JSON-LD, Microdata, RDFa), find invalid JSON-LD, and get the markup types you're missing..
  • Heading CheckerSee the H1–H6 outline of any page.