propertycasualty360.com
robots.txt
Robots Exclusion Standard data for propertycasualty360.com
Resource Scan
Scan Details
Site Domain | propertycasualty360.com |
Base Domain | propertycasualty360.com |
Scan Status | Ok |
Last Scan | 2024-11-13T12:14:31+00:00 |
Next Scan | 2024-11-20T12:14:31+00:00 |
Last Scan
Scanned | 2024-11-13T12:14:31+00:00 |
URL | https://propertycasualty360.com/robots.txt |
Redirect | https://www.propertycasualty360.com/robots.txt |
Redirect Domain | www.propertycasualty360.com |
Redirect Base | propertycasualty360.com |
Domain IPs | 104.18.18.231, 104.18.19.231, 2606:4700::6812:12e7, 2606:4700::6812:13e7 |
Redirect IPs | 104.18.18.231, 104.18.19.231, 2606:4700::6812:12e7, 2606:4700::6812:13e7 |
Response IP | 104.18.19.231 |
Found | Yes |
Hash | 80923001aa625467bcae31335a5f1ac703e15f2a1f090f7ea18e44d520bb5e13 |
SimHash | 62045470c531 |
Groups
*
Rule | Path |
---|---|
Disallow | /*/?printer-friendly |
Disallow | /2020/02/17/somebody-tried-to-kill-him-2-miami-lawyers-a-hit-man-the-fbi-and-a-17m-verdict-414-172068/ |
Disallow | /2011/12/20/a-200k-patio-cover-no-insurance-fraud-yes/ |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://www.propertycasualty360.com/sitemap.xml |