Terms of service
Last updated: 6 August 2026
1. Service description
Robotsread is a web-based diagnostic tool that checks whether a search engine crawler can index a given URL. The tool fetches the URL and its corresponding robots.txt file, analyses indexability signals (meta robots tags, X-Robots-Tag headers, canonical links, and robots.txt rules), and returns a verdict. The tool does not create user accounts, store submitted URLs, send email notifications, or perform scheduled re-checks.
2. No accounts, no stored data
Robotsread does not require or support user accounts. Every check is stateless — no URL, verdict, or personal information is stored on any server. Data is processed in memory during the request and discarded when the response is complete. The tool does not use cookies for tracking or authentication.
3. Acceptable use
You agree to use Robotsread only for its intended purpose: checking whether a search crawler can index a URL. You may not:
- Use the tool to probe or attack websites
- Submit URLs at a rate that would constitute denial of service
- Attempt to reverse-engineer, modify, or exploit the tool beyond its documented interface
- Use the tool in any way that violates applicable laws
4. No warranty
Robotsread is provided "as is" and "as available" without any warranty of any kind, express or implied. The tool reports what the rules say about indexability, but does not guarantee how any search engine will actually treat a page. The operator makes no claims about the accuracy, completeness, or timeliness of any verdict or signal analysis. Use of the tool is at your own risk.
5. Limitation of liability
To the maximum extent permitted by applicable law, the operator of Robotsread shall not be liable for any damages arising out of or in connection with the use or inability to use the tool, including but not limited to reliance on a verdict or failure to index a page.
6. Platform limitations
Robotsread runs on Cloudflare Workers. Due to Cloudflare's network architecture, URLs hosted behind Cloudflare cannot be fetched from a Cloudflare Worker. This is a platform limitation, not a finding about the user's site. The tool displays a caveat about this limitation next to the URL input.
7. Changes to these terms
These terms may be updated at any time. The current version is published on this page with the date shown above. Continued use of the tool after changes constitutes acceptance of the updated terms.
8. Governing law
No governing law or jurisdiction has been specified because no legal entity has been registered for this product. Once the operator establishes a legal entity and jurisdiction, a governing law clause will be added.