Who runs it
ExaSearchBot is run by Exa, according to Exa, Exa Search Crawler.
What Exa says it is for
Exa describes its crawler this way.
“Exa is a search engine. Similar to other search engines, Exa uses a robot (ExaSearchBot) to discover and index pages on the public web. This index allows users to find, retrieve, and cite your content.” Exa, Exa Search Crawler
Exa states the purpose.
“Its purpose is search and retrieval: connecting people and applications to your content and sending them back to your site.” Exa, Exa Search Crawler
Exa names its other agents.
“Pages Exa fetches on a user's request, rather than by crawling, go out as ExaUser . Exa crawls images as ExaSearchBot-Images .” Exa, Exa Search Crawler
User-agent string and robots.txt token
User-agent string, from Exa.
Mozilla/5.0 (compatible; ExaSearchBot/1.0; +https://crawler.exa.ai/)From Exa, Exa Search Crawler.
robots.txt token: ExaSearchBot
Exa states its robots.txt product token.
“Its robots.txt product token is ExaSearchBot .” Exa, Exa Search Crawler
Vendor's own example, as printed on its page:
User-agent: ExaSearchBot
Disallow: /
Does blocking it affect AI search visibility?
Exa says its index lets users find, retrieve and cite your content. It also says robots.txt controls crawling, not indexing. Exa says an indexed page is removed after ExaSearchBot re-fetches it and sees a noindex meta tag or X-Robots-Tag header, so allow that fetch.
Exa says robots.txt controls crawling, not indexing.
“robots.txt controls crawling, not indexing. To remove a page already in Exa's index, use a noindex robots meta tag or an X-Robots-Tag: noindex header; ExaSearchBot drops the page after it next re-fetches it.” Exa, Exa Search Crawler
Exa explains how it picks rules.
“When choosing which rules to follow, it looks for a group addressed to ExaSearchBot. If you haven't provided one, it follows the rules you've set for major search engines; otherwise it follows the * group.” Exa, Exa Search Crawler
How to find it in your logs
For request-level inspection, use your host, CDN or web-server logs, as in SearchIntel’s log study. Search the user-agent field for the name. On a server with shell access:
grep -i "ExaSearchBot/" access.log
The same company uses other identifiers: ExaUser, ExaSearchBot-Images. Search for each separately and count each identifier separately, as the log study does for assistants and crawlers.
Google warns that user-agent strings can be spoofed, so verify the request before counting it.
Exa says every ExaSearchBot request is cryptographically signed.
“Every ExaSearchBot request is cryptographically signed using HTTP Message Signatures (RFC 9421), following the Web Bot Auth scheme.” Exa, Exa Search Crawler
Exa warns that user-agent strings can be spoofed.
“User-agent strings can be spoofed, so don't trust the string alone” Exa, Exa Search Crawler
What we saw in our own logs
These figures come from our post How to Track AI Crawlers on Your Website: A Week of Logs: one week of logs (19 to 25 October 2026) from two websites, a specialist research site and a smaller services site.
- SearchIntel’s October log study reports for research site, share of crawler requests: “Exa 27%”.
- SearchIntel’s October log study reports for services site, share of crawler requests: “Exa 17%”.
- SearchIntel’s October log study reports for Both sites, Exa compared with OpenAI's search crawler: “It was the second busiest crawler on both sites, and it made more than twice as many requests as OpenAI's search crawler on each (2.2 and 2.3 times).”.
- SearchIntel’s October log study reports for Both sites, week before: “It was ahead of OpenAI's search crawler in the week before as well, on both sites.”.
Read this as a snapshot: the post says to “treat the shares as a snapshot, not a benchmark or a trend”, and says “We used the bot labels Vercel exported”, so the labels are Vercel’s. Full method and limits are in the post.
Frequently asked questions
What is ExaSearchBot?
Exa says ExaSearchBot discovers and indexes pages on the public web so that Exa's users can find, retrieve and cite them. Exa also uses ExaUser for pages it fetches on a user's request.
Does blocking ExaSearchBot affect AI search visibility?
Exa says its index lets users find, retrieve and cite your content. It also says robots.txt controls crawling, not indexing. Exa says an indexed page is removed after ExaSearchBot re-fetches it and sees a noindex meta tag or X-Robots-Tag header, so allow that fetch.
How do I find ExaSearchBot in my logs?
Search the user-agent field of your host, CDN or web-server logs for the name, for example with grep -i "ExaSearchBot/" access.log. Google warns that user-agent strings can be spoofed, so verify the request before counting it.
Changelog
Last updated 17 November 2026.
- 17 November 2026: Pages published.
All bots: what each AI bot does on your website.