Get found in AI search

People now ask AI assistants for recommendations. SEODevil checks that AI crawlers can actually read your site, and tracks whether AI answers mention and cite you.

Start free audit AI readiness checks in every audit. Prompt tracking: 2 prompts per site on Free, 25 on Pro and Agency.

How it works

  1. 1

    Check AI crawler access

    Every audit tests your robots.txt rules for 14 AI crawlers and requests your page as GPTBot, ClaudeBot and PerplexityBot to catch firewall and CDN blocks.

  2. 2

    Make your content readable

    SEODevil compares your HTML before and after JavaScript runs. Most AI crawlers don't run JavaScript, so content that only appears afterwards is invisible to them.

  3. 3

    Publish llms.txt

    Generate an llms.txt file from your own pages: a short summary of your site with links to its most important content.

  4. 4

    Track your prompts

    Add the questions your customers ask, like "best accounting software for freelancers". Each week SEODevil asks them with live web search and records whether you were mentioned or cited, and who was instead.

Search bots vs. training bots

Blocking AI training crawlers like GPTBot is a reasonable choice and doesn't remove you from AI answers. Blocking AI search crawlers like OAI-SearchBot or PerplexityBot does. SEODevil tells the two apart and only flags blocked search bots as a problem.

How prompt tracking works

Prompts run through Claude with live web search, the same way AI search products look things up before they answer. SEODevil records whether your domain is mentioned or cited, and which sites were cited instead. Prompts run weekly, and you can rerun them by hand once an hour.

AI suggestions can draft starter prompts from your own pages so you don't have to begin from a blank list.

Good to know

  • Prompt tracking currently uses Claude with web search. Other assistants search the web differently, so treat results as a signal, not a guarantee of what ChatGPT or Perplexity will say.
  • You can test AI crawler access on any page without signing up with the free AI Crawler Checker.
Try it on your own site

Start with a free audit. No card needed.

Start free audit

Frequently asked questions

How do I get my website mentioned by ChatGPT?

Make sure AI search crawlers can reach your pages (robots.txt, firewall and CDN), serve your main content in the HTML rather than only after JavaScript runs, and publish clear pages that answer the questions your customers ask. SEODevil checks the first two in every audit and tracks the outcome with prompts.

What is llms.txt and do I need it?

llms.txt is a Markdown file at the root of your site that summarizes what you do and links to your key pages, written for AI assistants. It's optional and still an emerging convention, but it's cheap to add. SEODevil can generate one from your pages.

Does Cloudflare block AI crawlers?

It can. Cloudflare's AI bot blocking settings refuse AI crawlers at the network edge even when your robots.txt allows them. SEODevil's firewall probe catches this by requesting your page as an AI crawler.

More features