materialworld.co
robots.txt
Robots Exclusion Standard data for materialworld.co
Resource Scan
Scan Details
| Site Domain | materialworld.co |
| Base Domain | materialworld.co |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't establish SSL connection. |
| Last Scan | 2024-08-23T15:37:43+00:00 |
| Next Scan | 2024-11-21T15:37:43+00:00 |
Last Successful Scan
| Scanned | 2024-01-04T01:12:06+00:00 |
| URL | http://materialworld.co/robots.txt |
| Redirect | https://www.stylealert.co/robots.txt |
| Redirect Domain | www.stylealert.co |
| Redirect Base | stylealert.co |
| Domain IPs | 13.33.33.37, 13.33.33.64, 13.33.33.75, 13.33.33.91 |
| Redirect IPs | 18.205.36.100, 52.204.242.176, 54.157.58.70, 54.162.128.250 |
| Response IP | 52.204.242.176 |
| Found | Yes |
| Hash | c1d5eb5fb5576be3c42e02d522bf0b21ebeaaef90157ea6f2cef6f23119b4ae6 |
| SimHash | 221cd8230bb0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /shop/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |