OAI-SearchBot
Also called: OpenAI SearchBot
OAI-SearchBot is OpenAI's web crawler that indexes pages so they can appear in ChatGPT's search answers and citations. It identifies itself with an OAI-SearchBot user-agent, obeys robots.txt, and does not collect content to train models (GPTBot does that).
Three OpenAI crawlers, three different jobs
OpenAI runs several separate agents, and mixing them up leads to the wrong robots.txt rules. GPTBot crawls to train models. ChatGPT-User handles fetches a person triggers inside ChatGPT (for example, pasting a link), and OpenAI notes that robots.txt may not apply to these user-initiated actions. OAI-SearchBot is the one that builds ChatGPT’s search index.
You can spot it in your server logs by the tail of its user-agent:
compatible; OAI-SearchBot/1.4; +https://openai.com/searchbot
OpenAI publishes the crawler’s IP ranges at openai.com/searchbot.json, so you can confirm a request is genuine instead of a spoofed agent string.
The control that matters: if you block OAI-SearchBot in robots.txt, your pages will not be shown in ChatGPT search answers, though they can still appear as plain navigational links. Robots.txt changes take roughly 24 hours to register. Because search inclusion and training are governed by separate directives, you can allow OAI-SearchBot (be visible in ChatGPT search) while blocking GPTBot (stay out of training data), or run any combination that fits your policy.
How it affects your traffic
If OAI-SearchBot cannot reach your pages, ChatGPT search cannot cite them, and you cede that referral channel to competitors who are visible there. Being crawlable is only step one: getting cited depends on clear, extractable answers, clean structure, and topical authority the model trusts. That is the work behind our AI SEO service, confirming the crawler can reach you and that what it finds is worth surfacing.
Get AI SEO that moves the needle
We turn terms like this into ranked pages and qualified pipeline. Start with a free Initial SEO Strategy.