Applebot-Extended: user agent, IP ranges and robots.txt

Applebot-Extended doesn't crawl anything. It's a robots.txt token that lets you opt your content out of training Apple's foundation models behind Apple Intelligence, Services and Developer Tools.

Operator
Apple
Type
Training · Collects content to train future models
robots.txt token
Applebot-Extended
Follows robots.txt
Control token only (no crawling)
IP list
not published
Official docs
support.apple.com

Applebot-Extended user agent

Applebot-Extended doesn't crawl webpages, so it never appears in your logs. Crawling is done by Applebot.

How to block or allow Applebot-Extended in robots.txt

Only used in robots.txt. Apple says pages that disallow Applebot-Extended can still appear in search results, and the rule isn't used for ranking.

Block Applebot-Extended

User-agent: Applebot-Extended
Disallow: /

Allow Applebot-Extended

User-agent: Applebot-Extended
Allow: /

Put the rules in /robots.txt at the root of each host. Check the result with our AI Crawler Checker, which also catches firewall and CDN blocks that robots.txt doesn't show.

Should you block Applebot-Extended?

Disallow it to keep your content out of Apple's AI training while staying in Siri and Spotlight.

How to verify real Applebot-Extended traffic

Nothing to verify: requests come from Applebot.

Frequently asked questions

What is Applebot-Extended?

Applebot-Extended doesn't crawl anything. It's a robots.txt token that lets you opt your content out of training Apple's foundation models behind Apple Intelligence, Services and Developer Tools.

How do I use Applebot-Extended in robots.txt?

Add "User-agent: Applebot-Extended" followed by "Disallow: /" to opt out. It doesn't crawl, so there's nothing to see in your logs. Only used in robots.txt. Apple says pages that disallow Applebot-Extended can still appear in search results, and the rule isn't used for ranking.

Checked against Apple's documentation on 2026-11-06. Vendors change user agents and policies, so confirm in the official docs before relying on them.

Related crawlers

Is Applebot-Extended allowed on your site?

The free AI Crawler Checker tests robots.txt and firewall rules for 14 AI crawlers in one run.

Check my site