PerplexityBot vs. Perplexity-User: which should you block?
Published 7/24/2026
Perplexity documents two crawler tokens with a clear, stated separation: one for indexing, one for answering a specific question.
The two tokens
PerplexityBot— search. Perplexity states this crawler is “designed to surface and link websites in search results on Perplexity” and is explicitly not used to train AI foundation models.Perplexity-User— user-triggered. Fetches a page when a person asks Perplexity a question that requires visiting it directly.
The decision
- Disallowing
PerplexityBotremoves your site from being indexed and cited in Perplexity’s search answers — this is the closest equivalent to blocking a conventional search engine. - Disallowing
Perplexity-Userprevents Perplexity from fetching your page on a user’s direct request, even if the user explicitly asked about your content. - Because Perplexity states neither token is used for foundation model training, there is no separate “training opt-out” decision to make for this operator, unlike OpenAI, Anthropic, Google, or Meta.
Common mistake CrawlPact flags
Site owners who want to “opt out of AI training” sometimes disallow PerplexityBot expecting a
training effect, then are surprised their site loses Perplexity search visibility with no
training-related benefit, since Perplexity’s own documentation states this crawler isn’t used for
that purpose. Confirm what a token actually does — via the
crawler directory — before writing a rule intended to achieve a specific outcome, or
check your own robots.txt directly with the AI crawler checker.
Related guides
Applebot vs. Applebot-Extended: Search/Siri vs. Apple Intelligence
Apple separates its long-standing search crawler from a newer, generative-AI-specific opt-out token. A decision guide for telling them apart.
Blocking AI training while staying visible in AI search
Choosing between CrawlPact's presets when the goal is opting out of model training without losing AI-search discoverability.
ClaudeBot vs. Claude-User vs. Claude-SearchBot: which should you block?
Anthropic operates three separate crawler tokens for training, user-triggered retrieval, and search. A decision guide for configuring each independently.
See how this applies to your own site
Run a free audit to check your declared AI crawler policy against your own domain.
Audit a domain