TL;DR. Cloudflare's Agent Readiness Score, published at isitagentready.com, tests roughly thirteen signals across four dimensions. The signals fall into three tiers: the basics every site should have (robots.txt, sitemap, llms.txt), the directional bets worth making now if you have any agent or developer surface (Content Signals, AGENTS.md, MCP server card), and the experimental layers that only matter if you ship an agent product yourself (Agent Skills, A2A agent card, Web Bot Auth). The score is useful as a thermometer. It's biased toward standards Cloudflare implements natively, so treat it as one input alongside Lighthouse and a classic accessibility audit.
Updated October 13, 2026: corrected the MCP Server Card description (it names your server and its endpoint, not its tools or authentication), and added a section on the AI catalog, which Lighthouse 13.5 now grades.
The four dimensions
Cloudflare's scorer groups its checks into four buckets.
Discoverability. Can an agent find what's on your site? Three signals: robots.txt, sitemap.xml, and Link response headers (RFC 8288). The first two are pre-AI baseline hygiene. Link headers are an underused way to advertise alternate representations of a page (a markdown version, a JSON-LD blob) via HTTP rather than HTML.
Content. Can an agent parse what's on your site without scraping the chrome? One signal here: Markdown content negotiation. Send Accept: text/markdown and the server returns a clean .md version of the same content. The pattern most sites use is a sibling .md URL or a content-negotiation rule at the edge.
Bot Access Control. Who can crawl, train, and use your content, and how do you express that? Three signals: AI bot rules in robots.txt (per-bot allow/disallow), Content Signals (the three-permission granularity for AI behavior), and Web Bot Auth (signed-request verification of well-behaved bots).
Capabilities. What can an agent do on your site? Six signals here, all centered on /.well-known/ discovery paths: Agent Skills, API Catalog (RFC 9727), OAuth Server Discovery (RFC 8414), OAuth Protected Resource (RFC 9728), MCP Server Card, and the A2A Agent Card.
A separate Commerce section tests for x402, the Universal Commerce Protocol, and the Agentic Commerce Protocol, but doesn't roll into the displayed score.
Tier 1: Ship now if you haven't
These are the signals every site should have, agent-readiness aside. The score will demand them; so will every other audit you run.
/robots.txtwith explicit rules for AI bots, not just the legacyUser-agent: *block. At minimum cover GPTBot, ClaudeBot, PerplexityBot, Google-Extended, Applebot-Extended, CCBot, and Bytespider. The AI Bot Policy Generator emits the standard set./sitemap.xml. Standard XML sitemap. Index sitemap if you have more than 50,000 URLs./llms.txtat the site root. A markdown reading list aimed at LLMs. The llms.txt Generator drafts one from your sitemap.
If you ship those three correctly the score's Discoverability dimension is in good shape and roughly a third of the total is locked in.
Tier 2: Directional bets worth making
The middle tier is where most decisions sit. Each of these has a clear use case but isn't yet universal. Ship them if the use case fits.
Markdown content negotiation. Two patterns work. The HTML pattern is a <link rel="alternate" type="text/markdown" href="/some-page.md"> element in the head of each page. The HTTP pattern is server-side content negotiation against Accept: text/markdown. The HTML pattern is easier to deploy; the HTTP pattern is closer to the original web architecture intent. Either is acceptable to the score. The Markdown for Agents Generator produces the markdown bodies.
Content Signals. Cloudflare's proposal for splitting AI permissions three ways. The mechanism is a content-signals: directive in robots.txt (and/or a meta-robots equivalent) that grants or denies ai-train, ai-input, and search separately. The combinations matter. Many publishers want search=yes (so AI search engines can include them) but ai-train=no (so models don't ingest them for training) and ai-input=yes (so a user pasting their URL into a chat session gets the content). Pre-Content-Signals, that combination was impossible to express in a standard way. The ai.txt Generator emits the directive in the canonical form.
AGENTS.md at root. Useful if your site has any developer surface (docs, API, repo). Read the dedicated post for the full breakdown.
MCP Server Card. A small JSON card that names your MCP server and says where its endpoint is. Under SEP-2127, now Final, the required fields are $schema, name, version and description, and the endpoint goes in remotes. The card does not list tools and does not advertise capabilities; a client gets the tools from tools/list once it connects. The recommended address is your MCP endpoint plus /server-card. Some scanners still read /.well-known/mcp/server-card.json, so serving the same bytes there does no harm. Only relevant if you ship an MCP server. If you do, the card is how agents find it.
The AI catalog. One JSON file that lists every agent resource on your site: your MCP server card, an A2A agent card, your agent skills. Each entry points to a card, and the card names the endpoint. The current spec is Agentic Resource Discovery (ARD) v0.91, a Proposal. Its canonical address is /.well-known/ard.json; the older /.well-known/ai-catalog.json is legacy. Publish one file at both addresses. isitagentready.com's own fix prompt for the catalog says to serve it as application/json.
What changed since: Lighthouse now grades the catalog
Lighthouse 13.5.0 added an ard-schema audit to its Agentic Browsing category, next to the llms-txt audit. Run it with npx lighthouse https://yourdomain.com/ --only-categories=agentic-browsing. Version 13.5.0 still reads only the legacy /.well-known/ai-catalog.json (or a file it is pointed to by robots.txt Agentmap: or a rel="ai-catalog" link). It checks the body, not the Content-Type. Any error scores 0. A low warning with no error caps the score at 0.9.
The mistakes I keep seeing:
- Extra fields in
host.hostis closed. It allowsdisplayName,identifier,documentationUrl,logoUrlandtrustManifest, and nothing else. Aurlordescriptioninsidehostis an error, and the score is 0. On October 13, 2026 every one of the 31 catalogs on a fleet of small sites I run scored 0 for exactly this reason. - Generic entry types. Each entry's
typeis a media type.application/jsonandtext/plainraise a low warning per entry in 13.5.0. Use the specific types instead, likeapplication/mcp-server-card+jsonfor an MCP card orapplication/a2a-agent-card+jsonfor an A2A card. - Things that are not agent resources. llms.txt, sitemaps, HTML pages and feeds do not belong in the entries.
The Agent Endpoint Inspector and the Mega Analyzer run Lighthouse's own ARD validator code on your catalog and explain each message in plain words.
Tier 3: Experimental layers
The third tier is the part of the score where most sites legitimately have nothing. Ship these when you have the specific use case; don't ship them as ceremony.
/.well-known/agent-skills/index.json. Declares discrete callable skills your agent or site exposes. Different from MCP tools in that skills are a higher-level abstraction (a complete task with inputs and outputs) versus MCP's lower-level tool primitives. Worth publishing if you ship Cursor extensions, custom Claude Skills, or any other agent capability bundle.
/.well-known/api-catalog (RFC 9727). A discovery file pointing at every OpenAPI / GraphQL / API definition on your site. The format is a JSON index. If you publish public APIs, this gives any agent a single canonical entry point.
/.well-known/oauth-authorization-server (RFC 8414). Describes your OAuth authorization server's endpoints and capabilities. Required if you offer authenticated agent flows. The companion /.well-known/oauth-protected-resource (RFC 9728) tells agents which authorization server to use for a given resource. Both are mainstream OAuth; the agent-readiness twist is just publishing them at the well-known paths.
/.well-known/http-message-signatures-directory (Web Bot Auth). A directory of public keys used by well-behaved bots to sign their requests. Lets your site verify bot identity instead of blanket-blocking by user-agent. If you operate a bot, publishing your public key here is the signal-of-good-citizenship play. If you run a site, accepting signatures means you can let trusted bots through tighter access controls.
/.well-known/agent-card.json. Google's Agent-to-Agent protocol discovery file. Declares an agent's capabilities to other agents in the A2A ecosystem. Skip unless you ship an agent product.
How the score is calibrated
Cloudflare's scorer favors signals Cloudflare can deliver natively from its own products: Content Signals (introduced via Cloudflare blog posts), Web Bot Auth (Cloudflare AI Audit feature), MCP Server Card (Cloudflare Workers + Pages templates). That's not a criticism. Every vendor's audit tool reflects its commercial worldview. The right reading of the score is: it's a useful thermometer for "is this site agent-friendly," it's a less useful answer to "is this site ranking well for AI search."
For the search-ranking question, you want a tool that scores against what AI retrievers actually use, which today is schema density, citation surface, and the same E-E-A-T signals that drive classical search. The Mega SEO Analyzer folds the Cloudflare-style agent-readiness signals into a wider scorecard that includes ranking authority, hygiene, performance, security, trust, and the new Helpful Content (HCU) dimension.
A reasonable rollout order
If you're starting from zero, this is the order that has the highest payoff for the time invested:
- Fix robots.txt to cover AI bots explicitly. (15 minutes)
- Publish
sitemap.xmlif you don't already. (Eleventy, Astro, Next, Hugo all generate one with a plugin or built-in.) - Publish
llms.txtat root. (Generator, 10 minutes.) - Add Content Signals to robots.txt. (5 minutes, ai.txt Generator.)
- Add Markdown for Agents to your main pages. (Generator, per-page.)
- If you have a developer surface, publish
AGENTS.mdat root. (30 minutes.) - If you ship an API, publish
/.well-known/api-catalog. (15 minutes for a small API; longer for big surfaces.) - If you ship an MCP server, publish the server card and list it in your AI catalog. (The card is an optional MCP extension, now Final.)
Steps 1 to 5 will move most sites from a Cloudflare score in the 20s to one in the 50s or 60s. Steps 6 to 8 push past 80 if and only if the use cases apply. Sites without a developer or agent surface should not chase the last twenty points by shipping ceremony files.
Other scanners to pair it with
- Lighthouse. Classic Core Web Vitals + accessibility + best practices. Independent of agent readiness; covers the parts the score doesn't.
- The Mega SEO Analyzer for the agent signals plus ranking, HCU, security, and trust in one pass.
- The AI Posture Audit for AI bot policy consistency across robots.txt, ai.txt, and meta robots.
- The Agent-Ready Audit for the full well-known + agent-card set in one tool.
Related reading
- AGENTS.md: The Root-Level README That AI Coding Agents Actually Read
- llms-ctx.txt and llms-ctx-full.txt: The FastHTML Extensions to llms.txt
- Markdown for Agents: Serving Your Pages Twice
- The Open Agent Protocol Stack
- The Agent Runtime: The New Browser Layer
- Four agent readiness checks on six sites, side by side (October 2026)
Most of the signals above belong to the under-$100 AI stack we've been building all year. The full thesis (free SMB tools as top of funnel, agent-ready artifacts as load-bearing infrastructure, sub-$100 monthly spend) is the spine of The $20 Dollar Agency.
Fact-check notes and sources
- Cloudflare: Introducing the Agent Readiness score
- isitagentready.com: public scorer
- IETF: RFC 9727: API Catalog
- IETF: RFC 8414: OAuth 2.0 Authorization Server Metadata
- IETF: RFC 9728: OAuth 2.0 Protected Resource Metadata
- IETF: HTTP Message Signatures (RFC 9421)
- Anthropic: Model Context Protocol specification
- Google: Agent-to-Agent (A2A) protocol announcement
- October 13, 2026 update: MCP Server Cards are SEP-2127, status Final, with required
$schema,name,version,description, endpoints inremotes, no tools or capabilities, recommended at<mcp-url>/server-card: SEP-2127 and ext-server-card, read October 13, 2026. ARD v0.91 (Proposal, August 26, 2026), canonical/.well-known/ard.json, legacy/.well-known/ai-catalog.json: ARD spec and ard-spec, read October 13, 2026. Lighthouse 13.5.0 (published September 18, 2026)ard-schemaaudit, closedhost, scoring rules and media types per its bundled schema: Lighthouse on npm, read October 13, 2026. isitagentready.com fix prompt wording (application/json): isitagentready.com, read October 13, 2026. The 31-site result was measured October 13, 2026.
This post is informational. The Cloudflare Agent Readiness Score is a vendor-published metric and is not a search-ranking signal. Standards adoption is shifting; verify each spec's current status before building infrastructure around it.