travelagewest.com
robots.txt

Robots Exclusion Standard data for travelagewest.com

Resource Scan

Scan Details

Site Domain travelagewest.com
Base Domain travelagewest.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-06T20:59:42+00:00
Next Scan 2024-12-05T20:59:42+00:00

Last Successful Scan

Scanned2023-11-12T05:57:03+00:00
URL https://travelagewest.com/robots.txt
Redirect https://www.travelagewest.com/robots.txt
Redirect Domain www.travelagewest.com
Redirect Base travelagewest.com
Domain IPs 52.85.132.109, 52.85.132.48, 52.85.132.52, 52.85.132.58
Redirect IPs 13.33.88.67, 13.33.88.71, 13.33.88.83, 13.33.88.99, 2600:9000:223b:2e00:f:580:92c0:93a1, 2600:9000:223b:3200:f:580:92c0:93a1, 2600:9000:223b:7600:f:580:92c0:93a1, 2600:9000:223b:7800:f:580:92c0:93a1, 2600:9000:223b:8e00:f:580:92c0:93a1, 2600:9000:223b:ac00:f:580:92c0:93a1, 2600:9000:223b:d400:f:580:92c0:93a1, 2600:9000:223b:f000:f:580:92c0:93a1
Response IP 13.33.88.99
Found Yes
Hash 86aa8fb67b0697dd296a19ada0fb69987407975226c68245405aa4a9888afe60
SimHash ad0d9cc4cdb2

Groups

*

Rule Path
Disallow /User/
Disallow /Overlay/
Disallow /Test/

Other Records

Field Value
sitemap https://www.travelagewest.com/sitemap/sitemap.xml
sitemap https://www.travelagewest.com/gn/sitemap_gn.xml