clarksons.com
robots.txt

Robots Exclusion Standard data for clarksons.com

Resource Scan

Scan Details

Site Domain clarksons.com
Base Domain clarksons.com
Scan Status Ok
Last Scan2024-09-23T10:11:53+00:00
Next Scan 2024-10-23T10:11:53+00:00

Last Scan

Scanned2024-09-23T10:11:53+00:00
URL https://clarksons.com/robots.txt
Redirect https://www.clarksons.com/robots.txt
Redirect Domain www.clarksons.com
Redirect Base clarksons.com
Domain IPs 104.18.30.80, 104.18.31.80, 2606:4700::6812:1e50, 2606:4700::6812:1f50
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash 15053a30c5d6e1c3ba87fa1bf95212e2582b8dacbb4a41d5a8682701bd367433
SimHash b925dc42cb92

Groups

*

Rule Path
Disallow /search/*
Disallow /Umbraco

Other Records

Field Value
sitemap https://www.clarksons.com/xmlsitemap