www-archdaily-com.global.ssl.fastly.net
robots.txt
Robots Exclusion Standard data for www-archdaily-com.global.ssl.fastly.net
Resource Scan
Scan Details
| Site Domain | www-archdaily-com.global.ssl.fastly.net |
| Base Domain | www-archdaily-com.global.ssl.fastly.net |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-08-11T16:29:50+00:00 |
| Next Scan | 2024-11-09T16:29:50+00:00 |
Last Successful Scan
| Scanned | 2024-01-15T16:19:06+00:00 |
| URL | https://www-archdaily-com.global.ssl.fastly.net/robots.txt |
| Domain IPs | 151.101.1.194, 151.101.129.194, 151.101.193.194, 151.101.65.194 |
| Response IP | 199.232.45.194 |
| Found | Yes |
| Hash | c4a005d959e2e508fc832c814479dec4a0143eef6da4226dcd60595dfd5a33d7 |
| SimHash | c17c1c52cf93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *?replytocom |
| Allow | / |
| Disallow | /cl/ |
| Disallow | /catalog/cl/ |
| Disallow | /cn/ |
| Disallow | /br/ |
| Disallow | /catalog/br/ |
| Disallow | /us/ |
| Disallow | /mx/ |
| Disallow | /catalog/mx/ |
| Disallow | /co/ |
| Disallow | /catalog/co/ |
| Disallow | /pe/ |
| Disallow | /catalog/pe/ |
| Disallow | /1021178/AD |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.archdaily.com/sitemap.xml |