pendlesportswear.co.uk
robots.txt

Robots Exclusion Standard data for pendlesportswear.co.uk

Resource Scan

Scan Details

Site Domain pendlesportswear.co.uk
Base Domain pendlesportswear.co.uk
Scan Status Ok
Last Scan2024-11-02T06:33:23+00:00
Next Scan 2024-12-02T06:33:23+00:00

Last Scan

Scanned2024-11-02T06:33:23+00:00
URL https://pendlesportswear.co.uk/robots.txt
Redirect https://www.pendlesportswear.co.uk/robots.txt
Redirect Domain www.pendlesportswear.co.uk
Redirect Base pendlesportswear.co.uk
Domain IPs 95.138.190.21
Redirect IPs 95.138.190.21
Response IP 95.138.190.21
Found Yes
Hash e7a744e35aa7cfc63a550a76b87aa9f7c78fa07e11f59ced8b22125c72234b8e
SimHash 44505854ce93

Groups

*

Rule Path
Disallow /popups/
Disallow /sign-in/
Disallow /football-club-shops/manager-landing/forgotten-password/form.php
Disallow /shopping-basket/
Disallow /checkout/
Disallow .*%5C/feed%5C/

bl.uk_lddc_bot

Rule Path
Disallow /

*

Rule Path
Disallow /pages/preview.php

Other Records

Field Value
sitemap https://www.pendlesportswear.co.uk/sitemap.xml