prepsportswear.com
robots.txt

Robots Exclusion Standard data for prepsportswear.com

Resource Scan

Scan Details

Site Domain prepsportswear.com
Base Domain prepsportswear.com
Scan Status Ok
Last Scan2024-09-10T08:52:23+00:00
Next Scan 2024-10-10T08:52:23+00:00

Last Scan

Scanned2024-09-10T08:52:23+00:00
URL https://prepsportswear.com/robots.txt
Domain IPs 2600:9000:20fe:5600:c:c8b:a900:93a1, 2600:9000:20fe:6e00:c:c8b:a900:93a1, 2600:9000:20fe:7e00:c:c8b:a900:93a1, 2600:9000:20fe:8600:c:c8b:a900:93a1, 2600:9000:20fe:ac00:c:c8b:a900:93a1, 2600:9000:20fe:d000:c:c8b:a900:93a1, 2600:9000:20fe:f800:c:c8b:a900:93a1, 2600:9000:20fe:fe00:c:c8b:a900:93a1, 52.222.144.21, 52.222.144.39, 52.222.144.41, 52.222.144.92
Response IP 52.222.144.92
Found Yes
Hash 68bf4166e4f2ceee38be5f3091f15f17b58f4761b43840f2e098103e6df8a124
SimHash 18b65d0a8a12

Groups

*

Rule Path
Disallow /Account/
Disallow /BrandContent.aspx
Disallow /Store/
Disallow /account/
Disallow /admin/
Disallow /brandcontent.aspx
Disallow /cart
Disallow /cart/
Disallow /checkout/
Disallow /customerservice/coachescorner
Disallow /customerservice/coachescorner.aspx
Disallow /error/
Disallow /printer/
Disallow /secure/
Disallow /shoppingcart.aspx
Disallow /store/
Disallow /store/UpdateStore
Disallow /store/updatestore
Disallow /team/
Disallow /team_directory/
Disallow /api/images-load/

ccbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

g-i-g-a-b-o-t

Rule Path
Disallow /

sogou

Rule Path
Disallow /

java/1.8.0_121

Rule Path
Disallow /

companybook-crawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

Other Records

Field Value
sitemap https://prepsportswear.com/sitemap.xml

Comments

  • Blocked bots