USE CASE:
Telling whether AI assistants can read your website
The job here is telling whether AI assistants can read your website, and every real option for agent readability is below, ours and everyone else's. Mamba Labs builds Apify actors, and Agent Accessibility Auditor is the one here that does agent readability.
What is actually going wrong
A growing share of the people who will decide about your product never visit your site. An assistant reads it for them and reports back. If your pages are rendered entirely in JavaScript, or your robots file blocks the crawlers, or there is no structured markup, then what gets reported back is whatever the model already believed. Most site owners have never checked.
Traditional Search Tools
- Google's Rich Results Test. Free and authoritative on structured data, which is a large part of this. It says nothing about the AI crawlers specifically.
- Screaming Frog or a crawler. Crawls the site the way a bot does and shows what a bot sees. Built for SEO, and this question is close enough that it mostly works.
- Asking an assistant about your product. The crudest test and the most convincing one. If the answer is wrong, you have your finding.
- Read your own robots.txt and disable JavaScript. Two checks, ten minutes. Open robots.txt and look for the AI crawler rules, then load your key pages with JavaScript turned off and see what survives.
Mamba Labs Apify Actors
These are the actors we built for this job. If yours is not covered here, search from the bar at the top of the page or contact us here and tell us what you need.
- Agent Accessibility Auditor10 preconfigured tasks on this page's job.
Preconfigured tasks
A task is one of these actors with the inputs already filled in for a specific version of this job. Open one, swap in your own list, and run it without setting anything up from scratch.
- Audit a Homepage for Schema.org Markup
- Cheapest Agent Access Check, Three Requests
- Check an Online Store for AI Shopping Agents
- Check If a Website Has an llms.txt File
- JSON-LD Structured Data Checker by Domain
- Open Graph and Canonical Tag Checker
- OpenAPI and MCP Manifest Detector by Domain
- Re-Audit a Site Right After Shipping llms.txt
- RSS and Atom Feed Detector for a Website
- Sitemap Checker for a Website, One Request