jejamescycles.com
robots.txt

Robots Exclusion Standard data for jejamescycles.com

Resource Scan

Scan Details

Site Domain jejamescycles.com
Base Domain jejamescycles.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-23T14:56:12+00:00
Next Scan 2024-07-22T14:56:12+00:00

Last Successful Scan

Scanned2024-03-02T09:14:13+00:00
URL https://jejamescycles.com/robots.txt
Domain IPs 172.66.40.190, 172.66.43.66, 2606:4700:3108::ac42:28be, 2606:4700:3108::ac42:2b42
Response IP 172.66.40.190
Found Yes
Hash baa44e223846b5f883046ac604bc52b2a78a0f74fa0b38e8e2c90c27a43bc0c8
SimHash af5f7961ee19

Groups

googlebot

Rule Path
Disallow /nogooglebot/

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

sirdatabot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

sogou+web+spider

Rule Path
Disallow /

sogouspider

Rule Path
Disallow /

sogouwebspider

Rule Path
Disallow /

*

Rule Path
Disallow /bin/
Disallow /basket/
Disallow /order/
Disallow /account/
Disallow /login/
Disallow /success/

Other Records

Field Value
sitemap /sitemap.xml

Comments

  • Group 1