Find what AI crawlers can't read on your site.

The AI site audit runs 18 checks of how easily AI search engines and agents can crawl, read and use your website.

The checks come in three groups: content and structure (semantic HTML, titles, structured data), discovery and crawlability (robots.txt access for crawlers like OAI-SearchBot and PerplexityBot, sitemaps and llms.txt, bot challenges, JavaScript-only content) and developer and agent readiness.

The audit also works out what kind of site you have (an online shop, a local business, a SaaS product, a publisher or blog) and whether it covers a sensitive topic such as money, health or the law, from your business brief and the pages it reads. It then adds the checks that matter for that kind of site, such as product markup and visible prices for a shop, your address, phone and opening hours for a local business, a pricing page and docs for software, named authors and dates for a publisher, and expert authors, sources and disclaimers for sensitive topics. Technical checks look at page weight and render-blocking files, the mobile viewport, language versions (hreflang), redirect chains and conflicting canonical links. An owner or admin can correct the detected category at any time.

You get a score out of 100 for the core checks, and one list of fixes ranked by how much each helps your kind of site, each with why it matters and step-by-step instructions. The extra checks read only the pages the audit already fetches, so they don't add requests to your site.

Yes. The audit is included in every workspace at no extra cost, and it keeps working after your trial ends, even without a plan. It needs a Probeli AI account and checks your workspace's own website.

Owners and admins can run it: the first audit any time, one re-run right after, then one every 24 hours. An audit usually takes a few minutes, and everyone on your team can see the results.

Yes, lightly, and only public pages. Probeli AI reads a site in four cases: its homepage when you add it as your website or as a competitor (and when you ask to read your own again in its settings, which also shows whether that read worked and why not), up to 40 of your pages (plus robots.txt, sitemaps and llms.txt) when you run the AI site audit, a few pages of your own website for its business brief, and pages that AI answers cite, to find the brands they name.

For the brief, Probeli AI reads your homepage and up to 4 key pages, such as about, products or pricing, one at a time, and one workspace's brief doesn't read your site again within 10 minutes.

Every request identifies itself as ProbeliAIBot. The audit, the brief and the cited-page reader follow robots.txt (the token is probeliaibot) for every request, sitemaps, llms.txt and redirects included, and limit how fast they send requests to each site. Only robots.txt itself and the homepage read of your own website when you enter it or ask to read it again aren't subject to it. If your robots.txt blocks ProbeliAIBot, the AI site audit runs as a limited audit. Our ProbeliAIBot page lists those requests and has the details.