FOR PUBLISHERS
AI agents are already browsing your site. ARW ensures they get accurate information, attribute your brand, and can complete transactions—all on your terms.
AI companies deploy increasingly sophisticated agents—computer vision, code execution, multimodal browsers—to scrape your content freely. You can't stop them, can't require attribution, and can't monetize their traffic.
ARW provides standardized policy declarations plus technical enforcement for actions.
Specify training vs. inference permissions, attribution requirements, and rate limits in machine-readable format. While advisory for content, provides legal foundation and accountability.
Declare how your brand should appear in AI responses. ARW headers communicate attribution requirements directly to agents.
AI-* headers identify which agents access your content. Monitor behavior, measure impact, and build accountability when policies are violated.
Actions require OAuth—agents cannot add to cart, submit tickets, or complete transactions without user authorization. Technically unbypassable.
Users complete purchases through agents with OAuth consent. Track agent-driven conversions and turn agent traffic into revenue.
OAuth-gated actions ensure transactions flow through your platform. Maintain customer relationships and protect revenue streams.
Products appear in AI recommendations with attribution. Purchases require OAuth and flow through your platform. Agent traffic becomes a conversion channel.
{
"training": { "allowed": false },
"inference": { "allowed": true },
"attribution": { "required": true },
"actions": {
"add_to_cart": { "auth": "oauth2" },
"checkout": { "auth": "oauth2" }
}
}Content helps users via agents, but full articles require website visit. Attribution drives brand awareness and traffic back to your site.
{
"training": { "allowed": false },
"inference": {
"allowed": true,
"conditions": ["attribution_required", "excerpt_only"]
},
"attribution": {
"required": true,
"excerptLimit": 150
}
}Docs help developers via agents, but trials and tickets require OAuth. Track agent-driven signups for product-led growth.
{
"training": { "allowed": true },
"inference": { "allowed": true },
"attribution": { "required": true },
"actions": {
"signup_trial": { "auth": "oauth2", "tracking": true },
"create_ticket": { "auth": "oauth2" }
}
}Start with basic policies and add features incrementally. Each step adds value without breaking existing functionality.
Create basic llms.txt with policy declarations. Define training/inference permissions and attribution requirements.
Build .llm.md files for your top 20 pages. Provide clean, structured content that reduces hallucinations.
Implement AI-* HTTP headers to identify agents and communicate policies in real-time.
Build action endpoints with OAuth enforcement. Enable transactions through agents with user consent.
Agent traffic is already 10-20% at many sites. By 2026, it could be 30-40%. Establish standards now or accept extraction as inevitable.