Paste any URL. Robotsread checks four indexability signals and names the exact rule that blocks it.
Paste a URL. Robotsread checks the page and its robots.txt, then answers one question directly: can a search crawler index this, and if not, which specific rule stops it.
/api/check which does not exist yet. No actual URL fetching, robots.txt parsing, or verdict delivery occurs.
Indexability is decided in four places that contradict each other
A robots.txt Disallow, a meta robots tag, an X-Robots-Tag response header, and a canonical pointing elsewhere — each can block a page while the other three permit it. Most tools report each signal separately and leave you to reconcile them. This one states the verdict and names the rule that produced it.
What you get
One verdict, no ambiguity
Blocked, allowed, or soft-blocked — the tool resolves conflicting signals and names exactly which rule wins.
All four signals inspected
robots.txt rules, meta robots tags, X-Robots-Tag headers, and cross-domain canonical references. Every layer that can block a page is checked.
The blocking rule identified
You get the exact text of the rule that stopped the crawler — Disallow /wp-admin/ or meta robots content='noindex' — so you know what to fix.
Try it now
Takes less than five seconds. No account needed.
Check a URL