Agent Accessibility Auditor

live$0.005/resultEnrichment

Can an AI agent read this site. Checks llms.txt, robots AI crawler rules and the Content Signal policy, structured data, render mode, and machine readable endpoints like sitemap, OpenAPI and well known files. Every field is a fact read off a fetch, never a model opinion.

Use Cases

  • Who buys it. Built for a technical SEO or growth engineer preparing a site for AI crawlers and agent traffic, or an agency selling that work and needing a before and after audit across a client list.
  • Clay enrichment column. Audit whether a site is readable by AI agents, covering llms.txt, robots AI policy, structured data, and render mode.

Features

  • 42 flat fields, snake_case, one row per domain
  • llms.txt family validated by body, not just a 200 status
  • robots.txt AI crawler policy, including Content Signal directives
  • Structured data presence and health, plus render mode
  • Twelve requests per domain, typically 2 to 4 seconds

Input

domainstringrequired

One domain, for example vercel.com. Protocol and path are stripped

check_endpointsbooleanoptional

Probes sitemap, OpenAPI, well known files and feeds. Adds 7 concurrent requests. Default: true.

check_structured_databooleanoptional

Parses JSON-LD, microdata, Open Graph and canonical off the homepage. Costs no extra requests. Default: true.

skipCachestringoptional

Leave as false to use the 7 day cache. Default: false.

Output schema

json
{
  "domain": "vercel.com",
  "has_llms_txt": true,
  "llms_txt_bytes": 207885,
  "robots_ai_policy": "none",
  "content_signal_present": true,
  "content_signal_ai_train": "no",
  "jsonld_block_count": 1,
  "jsonld_broken_count": 0,
  "text_ratio_pct": 0.6,
  "render_mode": "client_rendered",
  "endpoints_found": "/sitemap.xml, /.well-known/security.txt",
  "endpoints_soft_404": "/openapi.json, /feed, /rss.xml, /llms-full.txt, /ai.txt",
  "agent_readable_score": 77,
  "agent_readable_tier": "open",
  "fetch_status": "ok"
}

Pricing

$0.005per result

Pay-per-event billing on the Apify platform. You are charged only when the actor returns a result. No subscription, no seat license.

Free-tier Apify accounts include monthly free compute. Upgrade for higher concurrency and volume.

Available on

Apify Store