Find out in seconds whether search engines and AI crawlers can actually reach your pages — or whether one line in a text file is quietly blocking them.
3 free checks a day without an account. Sign in free for more.
Disallow: / in robots.txt is the single most expensive typo in SEO. It is added during development to keep a staging site out of Google, and then it ships to production. Weeks later traffic has vanished and nobody knows why. A robots.txt checker takes ten seconds and rules that out for good.
Blocking AI crawlers is a legitimate choice, but it should be a decision rather than an accident. Many sites inherited AI-bot blocks from a security plugin or a hosting default and have no idea their content is invisible to ChatGPT, Perplexity and Copilot. If being cited in AI answers matters to your business, those user-agents need explicit access.
A missing robots.txt is not fatal — crawlers assume everything is allowed. But having one lets you point to your sitemap and keep bots out of low-value paths.
Usually because it returns a 404, is served as HTML instead of XML, or lists URLs on a different domain than the sitemap itself.
No. Blocking a page stops it being crawled, not indexed. To remove a page, allow crawling and use a noindex meta tag.
Turn this tool into a lead magnet on your site. Your visitors get instant free results — you get engaged prospects.
Open Settings → Embeds, pick this tool, and set your allowed domains and daily visitor limit.
Copy the generated snippet into any page on your site. No build step, no dependencies.
The widget auto-resizes, matches your theme, and every run links back to a full report.
Works on any website
WordPress, Webflow, Shopify, or plain HTML — if you can paste a script tag, it works.
You control the throttle
Set per-visitor daily limits so embeds never burn through your monthly quota unexpectedly.
Light AeroSearch badge
Free embeds carry a small 'Powered by AeroSearch' badge. Paid plans can remove it entirely.
Embedding is included on every plan, free included.