diamondstuds.com
robots.txt
Robots Exclusion Standard data for diamondstuds.com
Resource Scan
Scan Details
| Site Domain | diamondstuds.com |
| Base Domain | diamondstuds.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-09-20T11:13:17+00:00 |
| Next Scan | 2025-12-19T11:13:17+00:00 |
Last Successful Scan
| Scanned | 2024-11-02T10:34:04+00:00 |
| URL | https://diamondstuds.com/robots.txt |
| Redirect | https://www.diamondstuds.com/robots.txt |
| Redirect Domain | www.diamondstuds.com |
| Redirect Base | diamondstuds.com |
| Domain IPs | 104.26.14.53, 104.26.15.53, 172.67.70.22, 2606:4700:20::681a:e35, 2606:4700:20::681a:f35, 2606:4700:20::ac43:4616 |
| Redirect IPs | 104.26.14.53, 104.26.15.53, 172.67.70.22, 2606:4700:20::681a:e35, 2606:4700:20::681a:f35, 2606:4700:20::ac43:4616 |
| Response IP | 172.67.70.22 |
| Found | Yes |
| Hash | d63f898ed5a83d1567b6de76c37453ac3b9fdbd4e3ed870f3ab5de8e7faee07e |
| SimHash | 5720cf0eb207 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /err_log |
| Disallow | /various_cron |
| Disallow | /newsletter |
| Disallow | /document |
| Disallow | /embediframe |
| Disallow | /login.html |
| Disallow | /register.html |
| Disallow | /index.php?file=login |
| Disallow | /index.php?file=register |
| Disallow | /index.php?file=shoppingcart |
| Disallow | /index.php?file=checkout_billing |
| Disallow | /index.php?file=checkout_review |
| Disallow | /index.php?file=order_receipt |
| Disallow | /index.php?file=checkout_billing_paypal |
| Disallow | /index.php?file=checkout_review_paypal |
| Disallow | /cdn-cgi/challenge-platform/h/b |
| Disallow | /cdn-cgi/challenge-platform/h/g |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |