sportpursuit.co.uk
robots.txt

Robots Exclusion Standard data for sportpursuit.co.uk

Resource Scan

Scan Details

Site Domain sportpursuit.co.uk
Base Domain sportpursuit.co.uk
Scan Status Ok
Last Scan2024-10-21T22:23:29+00:00
Next Scan 2024-11-20T22:23:29+00:00

Last Scan

Scanned2024-10-21T22:23:29+00:00
URL https://sportpursuit.co.uk/robots.txt
Redirect https://www.sportpursuit.com/robots.txt
Redirect Domain www.sportpursuit.com
Redirect Base sportpursuit.com
Domain IPs 108.157.254.116, 108.157.254.68, 108.157.254.8, 108.157.254.84
Redirect IPs 45.60.36.134
Response IP 45.60.36.134
Found Yes
Hash a8c9be42434c4b7618b7f235b69d5278a07bc404d88e16b85e1ad8c4f67e0d62
SimHash 4807de758763

Groups

baiduspider

Rule Path
Disallow /

*

Rule Path
Disallow /index.php/
Disallow /join/
Disallow /unsubscribe/
Disallow /deals/
Disallow /shopby/limit-all
Disallow /*/shopby/limit-all
Disallow /*shopby
Disallow /limit-*
Disallow /category/

Other Records

Field Value
sitemap https://www.sportpursuit.com/sitemap.xml