dickeys.com
robots.txt
Robots Exclusion Standard data for dickeys.com
Resource Scan
Scan Details
Site Domain | dickeys.com |
Base Domain | dickeys.com |
Scan Status | Ok |
Last Scan | 2024-06-20T22:37:38+00:00 |
Next Scan | 2024-07-20T22:37:38+00:00 |
Last Scan
Scanned | 2024-06-20T22:37:38+00:00 |
URL | https://dickeys.com/robots.txt |
Redirect | https://www.dickeys.com/robots.txt |
Redirect Domain | www.dickeys.com |
Redirect Base | dickeys.com |
Domain IPs | 52.70.35.190 |
Redirect IPs | 76.76.21.123, 76.76.21.142 |
Response IP | 76.76.21.123 |
Found | Yes |
Hash | 2b63907f2461a8a5eb3d855757ed6f21a4b8e992ce9c09d93d04c53c881baaa6 |
SimHash | 0801a8548d90 |
Groups
*
Rule | Path |
---|---|
Disallow | /*_buildManifest.js$ |
Disallow | /*_middlewareManifest.js$ |
Disallow | /*_ssgManifest.js$ |
Disallow | /quote/everyday/ |
Disallow | /quote/catering/ |
Disallow | /get-a-quote/866-barbecue/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.dickeys.com/sitemap.xml |