Log In Sign Up

b3dservice.de
robots.txt

Robots Exclusion Standard data for b3dservice.de

Resource Scan

Scan Details

Site Domain b3dservice.de
Base Domain b3dservice.de
Scan Status Ok
Last Scan2025-11-15T15:27:34+00:00
Next Scan 2025-12-15T15:27:34+00:00

Last Scan

Scanned2025-11-15T15:27:34+00:00
URL http://b3dservice.de/robots.txt
Domain IPs 80.237.213.236
Response IP 80.237.213.236
Found Yes
Hash 84273774553bdee6f06b7994cd54a3228f6aedfa8010d6c90ac43a0b25bb70cf
SimHash 3af69d43e9f0

Groups

amazonbot

Rule Path
Disallow /

betabot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

facebot

Rule Path
Disallow /

freshpingbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /image
Disallow /texture
Disallow /cat/
Disallow /item.do
Disallow /*/item.do
Back to top

Comments

  • Common Crawl AI data bot is not permitted to crawl this site
  • Alphabet/Google AI bots are not permitted to crawl this site
  • OpenAI is not permitted to crawl this site
  • Meta AI bots are not permitted to crawl this site
  • item.do for profiles/sub-contexts; note: wildcards are not supported by all bots
Back to top