justbats.com
robots.txt

Robots Exclusion Standard data for justbats.com

Resource Scan

Scan Details

Site Domain justbats.com
Base Domain justbats.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-25T09:21:10+00:00
Next Scan 2024-12-24T09:21:10+00:00

Last Successful Scan

Scanned2024-08-04T02:55:18+00:00
URL https://justbats.com/robots.txt
Redirect https://www.justbats.com/robots.txt
Redirect Domain www.justbats.com
Redirect Base justbats.com
Domain IPs 140.82.169.36
Redirect IPs 140.82.169.36
Response IP 140.82.169.36
Found Yes
Hash a2d69ca9e9ee93121da6d5d875ee57aa5c891d16e4fd3e590f538661b3ab2c55
SimHash aa4aaa9c49b2

Groups

shopwiki

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

speedy

Rule Path
Disallow /

sli_systems_indexer

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

brightedge crawler/1.0 (crawler@brightedge.com)

Rule Path
Disallow /

*

Rule Path
Disallow /cart/
Disallow /compare/

Other Records

Field Value
sitemap https://www.justbats.com/sitemap.xml

Comments

  • robots.txt for https://www.justbats.com