berliner-woche.de
robots.txt

Robots Exclusion Standard data for berliner-woche.de

Resource Scan

Scan Details

Site Domain berliner-woche.de
Base Domain berliner-woche.de
Scan Status Ok
Last Scan2024-11-09T08:42:36+00:00
Next Scan 2024-11-16T08:42:36+00:00

Last Scan

Scanned2024-11-09T08:42:36+00:00
URL https://berliner-woche.de/robots.txt
Redirect https://www.berliner-woche.de/robots.txt
Redirect Domain www.berliner-woche.de
Redirect Base berliner-woche.de
Domain IPs 151.106.64.144
Redirect IPs 151.106.64.144
Response IP 151.106.64.144
Found Yes
Hash ddae5e09cb78c9e972c4d31f1c416fb517e2ec32c2986b36cdbd8f8b2002e511
SimHash 710544435112

Groups

*

Rule Path
Disallow /build/html/
Disallow /customerfonts/
Allow /resources/mediadb/
Disallow /resources/
Disallow /uploads/
Disallow /event/download/

Other Records

Field Value
sitemap https://www.berliner-woche.de/sitemap.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449