CrawlPactGPTBot
- User-agent token
- GPTBot
- Purpose
- Training
- Status
- active
- Last verified
- 2026-07-24
GPTBot identifies itself with the user-agent token GPTBot and is documented by OpenAI as a
crawler used to collect content that may inform the training of future OpenAI models.
What blocking GPTBot does
Disallowing GPTBot in robots.txt signals that a website does not want its content used for
this specific training purpose. It does not affect OpenAI’s other documented crawlers, such as
OAI-SearchBot (search) or ChatGPT-User (user-triggered retrieval), which are evaluated and
reported separately by CrawlPact.
Verifying this record
Always cross-check the current token and behaviour against OpenAI’s own crawler documentation
before relying on this page for a production decision — crawler documentation can change
between CrawlPact’s registry releases. OpenAI’s crawler documentation moved from
platform.openai.com/docs/bots to developers.openai.com/api/docs/bots since this record was
first added; the citation above reflects the current location as of the last-verified date.
Example robots.txt configuration
To disallow GPTBot specifically, without affecting any other crawler:
User-agent: GPTBot
Disallow: /If no dedicated User-agent: GPTBot group exists in a domain's robots.txt, this crawler falls back to whatever the wildcard User-agent: * group says (RFC 9309) — see robots.txt syntax basics for how group selection works.
Verified against the source above as of 2026-07-24 — see how CrawlPact verifies crawler information.
See how this applies to your own site
Run a free audit to check your declared AI crawler policy against your own domain, or use the AI crawler checker to check this one crawler specifically.
Audit a domain