Preview environment
CrawlPact

Perplexity AI

PerplexityBot

User-agent token
PerplexityBot
Purpose
Search
Status
active
Last verified
2026-07-01

PerplexityBot crawls and indexes web content that Perplexity’s search product may cite when answering user queries.

Site-owner controls

Disallowing PerplexityBot removes this content from consideration when Perplexity’s search product cites sources in its AI-generated answers. It does not affect Perplexity-User, the separate user-triggered fetcher Perplexity documents, which operates independently of indexing decisions. See /limitations for what a robots.txt rule can and cannot guarantee.

Perplexity also documents Perplexity-User, a separate user-triggered crawler that fetches a specific page in direct response to a user’s request inside a Perplexity product. CrawlPact reports these as distinct rows in the crawler matrix because they serve different purposes.

Example robots.txt configuration

To disallow PerplexityBot specifically, without affecting any other crawler:

User-agent: PerplexityBot
Disallow: /

If no dedicated User-agent: PerplexityBot group exists in a domain's robots.txt, this crawler falls back to whatever the wildcard User-agent: * group says (RFC 9309) — see robots.txt syntax basics for how group selection works.

Official source: https://docs.perplexity.ai/guides/bots

Verified against the source above as of 2026-07-01 — see how CrawlPact verifies crawler information.

Related guides

Related crawlers

See how this applies to your own site

Run a free audit to check your declared AI crawler policy against your own domain, or use the AI crawler checker to check this one crawler specifically.

Audit a domain