justballgloves.com
robots.txt

Robots Exclusion Standard data for justballgloves.com

Resource Scan

Scan Details

Site Domain justballgloves.com
Base Domain justballgloves.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-03T19:14:24+00:00
Next Scan 2024-12-02T19:14:24+00:00

Last Successful Scan

Scanned2024-07-13T19:13:10+00:00
URL https://justballgloves.com/robots.txt
Redirect https://www.justballgloves.com/robots.txt
Redirect Domain www.justballgloves.com
Redirect Base justballgloves.com
Domain IPs 140.82.169.37
Redirect IPs 140.82.169.37
Response IP 140.82.169.37
Found Yes
Hash 69df044a2a78b13ed5857252b09ee5771f84972657deccf73071dd99744ffc39
SimHash aa4baadc4b73

Groups

shopwiki

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

speedy

Rule Path
Disallow /

sli_systems_indexer

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

brightedge crawler/1.0 (crawler@brightedge.com)

Rule Path
Disallow /

*

Rule Path
Disallow /cart/
Disallow /compare/
Disallow /mobile/
Disallow /blogs/
Disallow /reviews/
Disallow /questions/
Disallow /js/
Disallow /css/

Other Records

Field Value
sitemap https://www.justballgloves.com/sitemap.xml

Comments

  • robots.txt for https://www.justballgloves.com