basics-berlin.de
robots.txt

Robots Exclusion Standard data for basics-berlin.de

Resource Scan

Scan Details

Site Domain basics-berlin.de
Base Domain basics-berlin.de
Scan Status Ok
Last Scan2025-07-20T17:20:09+00:00
Next Scan 2025-07-27T17:20:09+00:00

Last Scan

Scanned2025-07-20T17:20:09+00:00
URL http://basics-berlin.de/robots.txt
Redirect https://www.basics.berlin/robots.txt
Redirect Domain www.basics.berlin
Redirect Base basics.berlin
Domain IPs 2001:8d8:100f:f000::2e6, 217.160.0.190
Redirect IPs 188.245.81.129
Response IP 188.245.81.129
Found Yes
Hash 098eb90330feab6bd36071fe5cad3fbdbe44f19cac0244a955570279e1eceba1
SimHash 1454d9408516

Groups

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /