All AI bots
AI Bots

What ExaSearchBot Does on Your Website

What Exa says it is for, how to spot it in your logs, and what we saw in ours.

In short: Exa says ExaSearchBot discovers and indexes pages on the public web so that Exa's users can find, retrieve and cite them. Exa also uses ExaUser for pages it fetches on a user's request.

Who runs it

ExaSearchBot is run by Exa, according to Exa, Exa Search Crawler.

What Exa says it is for

Exa describes its crawler this way.

“Exa is a search engine. Similar to other search engines, Exa uses a robot (ExaSearchBot) to discover and index pages on the public web. This index allows users to find, retrieve, and cite your content.” Exa, Exa Search Crawler

Exa states the purpose.

“Its purpose is search and retrieval: connecting people and applications to your content and sending them back to your site.” Exa, Exa Search Crawler

Exa names its other agents.

“Pages Exa fetches on a user's request, rather than by crawling, go out as ExaUser . Exa crawls images as ExaSearchBot-Images .” Exa, Exa Search Crawler

User-agent string and robots.txt token

User-agent string, from Exa.

Mozilla/5.0 (compatible; ExaSearchBot/1.0; +https://crawler.exa.ai/)

From Exa, Exa Search Crawler.

robots.txt token: ExaSearchBot

Exa states its robots.txt product token.

“Its robots.txt product token is ExaSearchBot .” Exa, Exa Search Crawler

Vendor's own example, as printed on its page:

User-agent: ExaSearchBot
Disallow: /

Does blocking it affect AI search visibility?

Exa says its index lets users find, retrieve and cite your content. It also says robots.txt controls crawling, not indexing. Exa says an indexed page is removed after ExaSearchBot re-fetches it and sees a noindex meta tag or X-Robots-Tag header, so allow that fetch.

Exa says robots.txt controls crawling, not indexing.

“robots.txt controls crawling, not indexing. To remove a page already in Exa's index, use a noindex robots meta tag or an X-Robots-Tag: noindex header; ExaSearchBot drops the page after it next re-fetches it.” Exa, Exa Search Crawler

Exa explains how it picks rules.

“When choosing which rules to follow, it looks for a group addressed to ExaSearchBot. If you haven't provided one, it follows the rules you've set for major search engines; otherwise it follows the * group.” Exa, Exa Search Crawler

How to find it in your logs

For request-level inspection, use your host, CDN or web-server logs, as in SearchIntel’s log study. Search the user-agent field for the name. On a server with shell access:

grep -i "ExaSearchBot/" access.log

The same company uses other identifiers: ExaUser, ExaSearchBot-Images. Search for each separately and count each identifier separately, as the log study does for assistants and crawlers.

Google warns that user-agent strings can be spoofed, so verify the request before counting it.

Exa says every ExaSearchBot request is cryptographically signed.

“Every ExaSearchBot request is cryptographically signed using HTTP Message Signatures (RFC 9421), following the Web Bot Auth scheme.” Exa, Exa Search Crawler

Exa warns that user-agent strings can be spoofed.

“User-agent strings can be spoofed, so don't trust the string alone” Exa, Exa Search Crawler

What we saw in our own logs

These figures come from our post How to Track AI Crawlers on Your Website: A Week of Logs: one week of logs (19 to 25 October 2026) from two websites, a specialist research site and a smaller services site.

Read this as a snapshot: the post says to “treat the shares as a snapshot, not a benchmark or a trend”, and says “We used the bot labels Vercel exported”, so the labels are Vercel’s. Full method and limits are in the post.

Frequently asked questions

What is ExaSearchBot?

Exa says ExaSearchBot discovers and indexes pages on the public web so that Exa's users can find, retrieve and cite them. Exa also uses ExaUser for pages it fetches on a user's request.

Does blocking ExaSearchBot affect AI search visibility?

Exa says its index lets users find, retrieve and cite your content. It also says robots.txt controls crawling, not indexing. Exa says an indexed page is removed after ExaSearchBot re-fetches it and sees a noindex meta tag or X-Robots-Tag header, so allow that fetch.

How do I find ExaSearchBot in my logs?

Search the user-agent field of your host, CDN or web-server logs for the name, for example with grep -i "ExaSearchBot/" access.log. Google warns that user-agent strings can be spoofed, so verify the request before counting it.

Changelog

Last updated 17 November 2026.

All bots: what each AI bot does on your website.

See Whether AI Recommends Your Brand

Run a free check across ChatGPT, Claude, Gemini, Perplexity and Google AI Mode. See your score, your platform breakdown, and the competitors AI recommends instead.

Related bots