libertymutual.com
robots.txt

Robots Exclusion Standard data for libertymutual.com

Resource Scan

Scan Details

Site Domain libertymutual.com
Base Domain libertymutual.com
Scan Status Ok
Last Scan2024-11-08T04:30:27+00:00
Next Scan 2024-11-22T04:30:27+00:00

Last Scan

Scanned2024-11-08T04:30:27+00:00
URL https://libertymutual.com/robots.txt
Redirect https://www.libertymutual.com/robots.txt
Redirect Domain www.libertymutual.com
Redirect Base libertymutual.com
Domain IPs 23.210.99.27
Redirect IPs 23.210.109.205, 2600:1413:b000:390::1ddf, 2600:1413:b000:392::1ddf
Response IP 23.210.109.205
Found Yes
Hash 97d41b031a203468f7312858cf9cfb58c0d40ddb1b2c05cdcc952f3e871d4a5a
SimHash 690558048553

Groups

*

Rule Path
Disallow /lm/*
Disallow /safeco/*
Disallow /*.page*
Disallow /*/not-found
Disallow /local-office
Disallow /sales-representative

sistrix

Rule Path
Disallow /

kurogo server*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.libertymutual.com/sitemap.xml