Log In Sign Up

bernau.de
robots.txt

Robots Exclusion Standard data for bernau.de

Resource Scan

Scan Details

Site Domain bernau.de
Base Domain bernau.de
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-11-22T09:05:08+00:00
Next Scan 2025-12-06T09:05:08+00:00

Last Successful Scan

Scanned2025-10-14T07:40:42+00:00
URL https://bernau.de/robots.txt
Redirect https://www.bernau.de/robots.txt
Redirect Domain www.bernau.de
Redirect Base bernau.de
Domain IPs 178.250.10.150
Redirect IPs 178.250.10.150
Response IP 178.250.10.150
Found Yes
Hash dbf0c37b144727b48449c7771b4cee450d807c38263b42b0cda6bef3e2cf9ed5
SimHash 69540b126333

Groups

*

Rule Path
Disallow /visioncontent/

surveybot

Rule Path
Disallow /

websitewiki

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

jakarta commons-httpclient

Rule Path
Disallow /

aboutusbot

Rule Path
Disallow /

semager

Rule Path
Disallow /
Back to top

Comments

  • www.robotstxt.org/
  • Allow crawling of all content
  • D2
Back to top