justpaddles.com
robots.txt

Robots Exclusion Standard data for justpaddles.com

Resource Scan

Scan Details

Site Domain justpaddles.com
Base Domain justpaddles.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-13T07:28:04+00:00
Next Scan 2024-12-12T07:28:04+00:00

Last Successful Scan

Scanned2024-07-23T00:37:06+00:00
URL https://justpaddles.com/robots.txt
Redirect https://www.justpaddles.com/robots.txt
Redirect Domain www.justpaddles.com
Redirect Base justpaddles.com
Domain IPs 140.82.169.34
Redirect IPs 140.82.169.34
Response IP 140.82.169.34
Found Yes
Hash 87c64e5451d1e57862d88eefefd13e33565e354d9e52287ad5b8b859c9c51f16
SimHash aa4baad94173

Groups

shopwiki

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

speedy

Rule Path
Disallow /

sli_systems_indexer

Rule Path
Disallow /

yandex

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

brightedge crawler/1.0 (crawler@brightedge.com)

Rule Path
Disallow /

*

Rule Path
Disallow /cart/
Disallow /compare/

Other Records

Field Value
sitemap https://www.justpaddles.com/sitemap.xml

Comments

  • robots.txt for https://www.justpaddles.com