kubickidraper.com
robots.txt
Robots Exclusion Standard data for kubickidraper.com
Resource Scan
Scan Details
| Site Domain | kubickidraper.com |
| Base Domain | kubickidraper.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-24T09:04:11+00:00 |
| Next Scan | 2024-08-22T09:04:11+00:00 |
Last Successful Scan
| Scanned | 2022-10-23T22:34:51+00:00 |
| URL | http://kubickidraper.com/robots.txt |
| Response IP | 69.63.128.21 |
| Found | Yes |
| Hash | df6738cfb28329283c49fadd3cf379f6f58a1a73d480beb617fb6d3fa284c2e4 |
| SimHash | e409fa42ca93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *directive%3Dprint* |
| Disallow | *full.* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |