CrawlWitness

api.crawlwitness.com · 3 paid endpoints · listed 2026-10-31

Use when an agent is about to crawl, train on or ingest a website into RAG: checks the domain's AI consent and licensing signals (robots.txt per AI bot, RSL license, IETF AIPREF, TDMRep, noai meta tags, llms.txt, C2PA), returns a 0-100 score and a training stance, and a signed EAS receipt anchored on Base proving what was checked and when. Errors: 400 invalid domain; 502 site unreachable (not charged).

livelast check 15 h ago

100%valid x402 answers, 72 h

$0.057USDC received on Base, 7 days

4distinct payers, 7 days

54.8score (0-100)

Paid endpoints

Method	Endpoint	Price	Networks
GET	api.crawlwitness.com/v1/can-use Use when a crawler, scraper or RAG pipeline must decide whether it may use a website for AI: yes/no verdict for a domain, AI bot and use (train, rag, search) fr	$0.001	Base, Solana
GET	api.crawlwitness.com/v1/senales Use when an agent is about to crawl, train on or ingest a website into RAG: checks the domain's AI consent and licensing signals (robots.txt per AI bot, RSL lic	$0.005	Base, Solana
POST	api.crawlwitness.com/v1/batch Use when a crawler or dataset builder needs AI-consent verdicts for many domains at once: yes/no per domain for one AI bot and use (train, rag, search), up to 1	$0.02	Base, Solana

Latest checks

When	Endpoint	HTTP	ms	Result
15 h ago	api.crawlwitness.com/v1/batch	402	331	valid x402 v2 terms

Income on Base (7 days)

Day	Transfers	USDC
2026-11-02	5	$0.032
2026-11-01	3	$0.003
2026-10-31	3	$0.022

Is this your API?

Add the live badge to your docs:

<a href="https://logicnodes.io/observatory/p/api.crawlwitness.com"><img src="https://logicnodes.io/observatory/badge/api.crawlwitness.com.svg" alt="x402 status"></a>

Claim it for free with x402_provider_claim (sign with your payout address), and get an alert within minutes when it stops answering with x402_monitor_create ($5 for 30 days). Both work over MCP (https://logicnodes.io/mcp/v2) or POST https://logicnodes.io/v1/tools/<tool>.

Income is all USDC received by the provider's payout address on Base, whatever the source. Score: 0-100: 50 x share of checks in the last 72 h that returned valid x402 payment terms + 30 x min(1, log10(1 + USDC received in 7 days) / 4) + 20 x min(1, log10(1 + distinct payers in 7 days) / 3). A provider never checked scores on income only; income is all USDC received by its payout address on Base, whatever the source. JSON: /v1/observatory/providers/api.crawlwitness.com