b-bot.nl
robots.txt

Robots Exclusion Standard data for b-bot.nl

Resource Scan

Scan Details

Site Domain b-bot.nl
Base Domain b-bot.nl
Scan Status Ok
Last Scan2026-04-05T03:41:31+00:00
Next Scan 2026-04-12T03:41:31+00:00

Last Scan

Scanned2026-04-05T03:41:31+00:00
URL https://b-bot.nl/robots.txt
Domain IPs 2a00:1c98:1000:10f4:0:1:7b2c:4f39, 77.241.81.2
Response IP 77.241.81.2
Found Yes
Hash 6cabfceca2c450cc755fd58bb1c6968417fee9e86d825fa299ad4157f26815d9
SimHash c13898522db2

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://b-bot.nl/sitemaps-1-sitemap.xml
sitemap https://b-bot.de/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://b-bot.nl/
  • live - don't allow web crawlers to index cpresources/ or vendor/