propertycasualty360.com
robots.txt

Robots Exclusion Standard data for propertycasualty360.com

Resource Scan

Scan Details

Site Domain propertycasualty360.com
Base Domain propertycasualty360.com
Scan Status Ok
Last Scan2024-06-12T01:55:08+00:00
Next Scan 2024-06-19T01:55:08+00:00

Last Scan

Scanned2024-06-12T01:55:08+00:00
URL https://propertycasualty360.com/robots.txt
Redirect https://www.propertycasualty360.com/robots.txt
Redirect Domain www.propertycasualty360.com
Redirect Base propertycasualty360.com
Domain IPs 104.18.12.120, 104.18.13.120, 2606:4700::6812:c78, 2606:4700::6812:d78
Redirect IPs 104.18.12.120, 104.18.13.120, 2606:4700::6812:c78, 2606:4700::6812:d78
Response IP 104.18.12.120
Found Yes
Hash 80923001aa625467bcae31335a5f1ac703e15f2a1f090f7ea18e44d520bb5e13
SimHash 62045470c531

Groups

*

Rule Path
Disallow /*/?printer-friendly
Disallow /2020/02/17/somebody-tried-to-kill-him-2-miami-lawyers-a-hit-man-the-fbi-and-a-17m-verdict-414-172068/
Disallow /2011/12/20/a-200k-patio-cover-no-insurance-fraud-yes/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.propertycasualty360.com/sitemap.xml