americangolf.co.uk
robots.txt

Robots Exclusion Standard data for americangolf.co.uk

Resource Scan

Scan Details

Site Domain americangolf.co.uk
Base Domain americangolf.co.uk
Scan Status Ok
Last Scan2024-09-17T04:47:45+00:00
Next Scan 2024-10-17T04:47:45+00:00

Last Scan

Scanned2024-09-17T04:47:45+00:00
URL https://americangolf.co.uk/robots.txt
Redirect https://www.americangolf.co.uk/robots.txt
Redirect Domain www.americangolf.co.uk
Redirect Base americangolf.co.uk
Domain IPs 104.17.69.11, 104.17.70.11
Redirect IPs 104.17.5.1, 104.17.6.1
Response IP 104.17.6.1
Found Yes
Hash a2cd8f85395bae288096b45d6dbf8f433ad7605d0157e7443aa3d94a4cbd347d
SimHash 2d04d870ce96

Groups

*

Rule Path
Disallow *prefn1*
Disallow *search*
Disallow /on/demandware.store/
Disallow /shipping/
Disallow /billing/
Disallow /orderconfirmation/
Disallow /revieworder/
Disallow /checkout-giropaycancel/
Disallow /giropay-orderconfirmation/
Disallow /checkout-idealcancel/
Disallow /ideal-orderconfirmation/
Disallow /checkout-paypalcancel/
Disallow /paypal-orderconfirmation/
Disallow /checkout-sofortcancel/
Disallow /sofort-orderconfirmation/
Disallow /confirmation/
Disallow /shopping-cart/
Disallow /checkout/
Disallow /register-for-club/
Disallow /order-track/
Disallow /reserve-and-collect/

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.americangolf.co.uk/sitemap_index.xml