Log In Sign Up

trauer.schwarzwaelder-bote.de
robots.txt

Robots Exclusion Standard data for trauer.schwarzwaelder-bote.de

Resource Scan

Scan Details

Site Domain trauer.schwarzwaelder-bote.de
Base Domain schwarzwaelder-bote.de
Scan Status Ok
Last Scan2025-08-28T08:29:32+00:00
Next Scan 2025-09-27T08:29:32+00:00

Last Scan

Scanned2025-08-28T08:29:32+00:00
URL https://trauer.schwarzwaelder-bote.de/robots.txt
Domain IPs 5.252.232.103
Response IP 5.252.232.103
Found Yes
Hash 154985922dbb1165ab4963cc91a81bba43f6bacdf2e4b924c54289af1ff94212
SimHash 32340d3869e5

Groups

*

Rule Path
Disallow /Microsite/Views/Controls/
Disallow /traueranzeige/content/
Disallow /content/User/LoginForm
Disallow /content/user/LoginUser
Disallow /meine-daten/
Disallow /account/registieren
Disallow /trauerratgeber-suche/
Disallow /*.pdf$
Disallow /*.m4v$

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://trauer.schwarzwaelder-bote.de/sitemap.xml
Back to top

Comments

  • Legal notice: We expressly reserve the right to use our content for commercial text and data mining (ยง 44 b UrhG)
  • The use of robots or other automated means to access our sites or collect or mine data without our express permission is strictly prohibited.
  • If you would like to apply for permission to crawl our site, collect or use data, please contact us using https://www.sz-archiv.de/sz-content/text-data-mining
Back to top