propertycasualty360.com
robots.txt

Robots Exclusion Standard data for propertycasualty360.com

Resource Scan

Scan Details

Site Domain propertycasualty360.com
Base Domain propertycasualty360.com
Scan Status Ok
Last Scan2024-11-13T12:14:31+00:00
Next Scan 2024-11-20T12:14:31+00:00

Last Scan

Scanned2024-11-13T12:14:31+00:00
URL https://propertycasualty360.com/robots.txt
Redirect https://www.propertycasualty360.com/robots.txt
Redirect Domain www.propertycasualty360.com
Redirect Base propertycasualty360.com
Domain IPs 104.18.18.231, 104.18.19.231, 2606:4700::6812:12e7, 2606:4700::6812:13e7
Redirect IPs 104.18.18.231, 104.18.19.231, 2606:4700::6812:12e7, 2606:4700::6812:13e7
Response IP 104.18.19.231
Found Yes
Hash 80923001aa625467bcae31335a5f1ac703e15f2a1f090f7ea18e44d520bb5e13
SimHash 62045470c531

Groups

*

Rule Path
Disallow /*/?printer-friendly
Disallow /2020/02/17/somebody-tried-to-kill-him-2-miami-lawyers-a-hit-man-the-fbi-and-a-17m-verdict-414-172068/
Disallow /2011/12/20/a-200k-patio-cover-no-insurance-fraud-yes/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.propertycasualty360.com/sitemap.xml