herrbischoff.com
robots.txt

Robots Exclusion Standard data for herrbischoff.com

Resource Scan

Scan Details

Site Domain herrbischoff.com
Base Domain herrbischoff.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-07-10T07:57:39+00:00
Next Scan 2025-08-09T07:57:39+00:00

Last Successful Scan

Scanned2025-05-19T07:33:51+00:00
URL https://herrbischoff.com/robots.txt
Domain IPs 2a01:4f8:c17:c1ab::1, 88.99.124.138
Response IP 88.99.124.138
Found Yes
Hash 6c25005795ed4bcb2d66c1bbf0867aebe5e1c16e211c771e9d06a26db3529e7a
SimHash 40194bc3c2f5

Groups

applebot
bingbot
duckduckbot
googlebot
qwantify
seznambot

Rule Path
Disallow /*/snapshot/*
Disallow /contact
Disallow /hosts
Disallow /its-a-trap
Disallow /mirrors
Disallow /plugins
Allow /

adidxbot
adsbot-google
bingpreview
google-adwords-instant
googlebot-image
googlebot-news
googlebot-video

Rule Path
Disallow /

amazonbot
anthropic-ai
applebot-extended
bytespider
ccbot
chatgpt-user
claude-web
claudebot
cohere-ai
diffbot
facebookbot
google-extended
googleother
gptbot
imagesiftbot
imagesiftbot
meta-externalagent
meta-externalfetcher
omgili
omgilibot
omigili
omigilibot
perplexitybot
timpibot
youbot

Rule Path
Disallow /

*

Rule Path
Disallow /