bosch-ebike.com
robots.txt

Robots Exclusion Standard data for bosch-ebike.com

Resource Scan

Scan Details

Site Domain bosch-ebike.com
Base Domain bosch-ebike.com
Scan Status Ok
Last Scan2024-11-04T16:52:16+00:00
Next Scan 2024-11-18T16:52:16+00:00

Last Scan

Scanned2024-11-04T16:52:16+00:00
URL https://bosch-ebike.com/robots.txt
Redirect https://www.bosch-ebike.com/robots.txt
Redirect Domain www.bosch-ebike.com
Redirect Base bosch-ebike.com
Domain IPs 213.183.3.114
Redirect IPs 2600:1413:b000:6::17d5:2bd5, 2600:1413:b000:6::17d5:2bd8, 96.17.96.23, 96.17.96.28
Response IP 104.88.70.146
Found Yes
Hash 02ecabf9fd5c5b639d3b7b3c5b778e09e6092add1023c545cbec001706fe3265
SimHash 631ed952c091

Groups

*

Rule Path
Disallow /fileadmin/EBC/downloads/Bedienungsanleitungen/B*
Disallow /interactive-journey/
Disallow *setLanguage*
Disallow *stage%5B*
Disallow *tab%5B*
Disallow /c-sprache/

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bosch-ebike.com/sitemap.xml
sitemap https://www.bosch-ebike.com/en/?type=1533906435
sitemap https://www.bosch-ebike.com/fr/?type=1533906435

Comments

  • SeekportBot does not understand Modern JavaScript and generates too many JavaScript errors.