pendlesportswear.co.uk
robots.txt
Robots Exclusion Standard data for pendlesportswear.co.uk
Resource Scan
Scan Details
Site Domain | pendlesportswear.co.uk |
Base Domain | pendlesportswear.co.uk |
Scan Status | Ok |
Last Scan | 2024-11-02T06:33:23+00:00 |
Next Scan | 2024-12-02T06:33:23+00:00 |
Last Scan
Scanned | 2024-11-02T06:33:23+00:00 |
URL | https://pendlesportswear.co.uk/robots.txt |
Redirect | https://www.pendlesportswear.co.uk/robots.txt |
Redirect Domain | www.pendlesportswear.co.uk |
Redirect Base | pendlesportswear.co.uk |
Domain IPs | 95.138.190.21 |
Redirect IPs | 95.138.190.21 |
Response IP | 95.138.190.21 |
Found | Yes |
Hash | e7a744e35aa7cfc63a550a76b87aa9f7c78fa07e11f59ced8b22125c72234b8e |
SimHash | 44505854ce93 |
Groups
*
Rule | Path |
---|---|
Disallow | /popups/ |
Disallow | /sign-in/ |
Disallow | /football-club-shops/manager-landing/forgotten-password/form.php |
Disallow | /shopping-basket/ |
Disallow | /checkout/ |
Disallow | .*%5C/feed%5C/ |
*
Rule | Path |
---|---|
Disallow | /pages/preview.php |
Other Records
Field | Value |
---|---|
sitemap | https://www.pendlesportswear.co.uk/sitemap.xml |