dithmarschen.de
robots.txt

Robots Exclusion Standard data for dithmarschen.de

Resource Scan

Scan Details

Site Domain dithmarschen.de
Base Domain dithmarschen.de
Scan Status Ok
Last Scan2025-09-20T20:27:22+00:00
Next Scan 2025-10-20T20:27:22+00:00

Last Scan

Scanned2025-09-20T20:27:22+00:00
URL https://dithmarschen.de/robots.txt
Redirect https://www.dithmarschen.de/robots.txt
Redirect Domain www.dithmarschen.de
Redirect Base dithmarschen.de
Domain IPs 213.178.73.151
Redirect IPs 213.178.73.151
Response IP 213.178.73.151
Found Yes
Hash d2b8b4f390c934957a935fc8bf91ac683269088ab7017ab87d086b2bd82a9626
SimHash 6d515a20e3f3

Groups

*

Rule Path
Disallow

*

Rule Path
Disallow /typo3/
Disallow /typo3_src/
Allow /typo3/sysext/frontend/Resources/Public/*

Comments

  • "Old" NWS:
  • www.robotstxt.org/
  • Allow crawling of all content
  • Example from TYPO3