sportpursuit.com
robots.txt

Robots Exclusion Standard data for sportpursuit.com

Resource Scan

Scan Details

Site Domain sportpursuit.com
Base Domain sportpursuit.com
Scan Status Ok
Last Scan2024-11-07T08:16:36+00:00
Next Scan 2024-11-21T08:16:36+00:00

Last Scan

Scanned2024-11-07T08:16:36+00:00
URL https://sportpursuit.com/robots.txt
Redirect https://www.sportpursuit.com/robots.txt
Redirect Domain www.sportpursuit.com
Redirect Base sportpursuit.com
Domain IPs 45.60.104.134, 45.60.32.134
Redirect IPs 45.60.36.134
Response IP 45.60.36.134
Found Yes
Hash a8c9be42434c4b7618b7f235b69d5278a07bc404d88e16b85e1ad8c4f67e0d62
SimHash 4807de758763

Groups

baiduspider

Rule Path
Disallow /

*

Rule Path
Disallow /index.php/
Disallow /join/
Disallow /unsubscribe/
Disallow /deals/
Disallow /shopby/limit-all
Disallow /*/shopby/limit-all
Disallow /*shopby
Disallow /limit-*
Disallow /category/

Other Records

Field Value
sitemap https://www.sportpursuit.com/sitemap.xml