burgenstrasse.de
robots.txt

Robots Exclusion Standard data for burgenstrasse.de

Resource Scan

Scan Details

Site Domain burgenstrasse.de
Base Domain burgenstrasse.de
Scan Status Ok
Last Scan2024-11-05T05:24:21+00:00
Next Scan 2024-12-05T05:24:21+00:00

Last Scan

Scanned2024-11-05T05:24:21+00:00
URL https://burgenstrasse.de/robots.txt
Redirect https://www.burgenstrasse.de/robots.txt
Redirect Domain www.burgenstrasse.de
Redirect Base burgenstrasse.de
Domain IPs 78.46.186.33
Redirect IPs 78.46.186.33
Response IP 78.46.186.33
Found Yes
Hash e9b77641127d64c646ef2f612aab609a5328e8989ac63c74f6204d8da4c42f30
SimHash 8e4ff8444e61

Groups

*

Rule Path
Disallow /layout

*

Rule Path
Disallow /admin

*

Rule Path
Disallow /webalizer

*

Rule Path
Disallow /npwd.php

*

Rule Path
Disallow /usage2

*

Rule Path
Disallow /awstats

wget

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer pro

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

offline commander

Rule Path
Disallow /

leech

Rule Path
Disallow /

websnake

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

http weazel

Rule Path
Disallow /

screenerbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.