huernerhoefe.de
robots.txt

Robots Exclusion Standard data for huernerhoefe.de

Resource Scan

Scan Details

Site Domain huernerhoefe.de
Base Domain huernerhoefe.de
Scan Status Ok
Last Scan2024-11-09T11:22:29+00:00
Next Scan 2024-12-09T11:22:29+00:00

Last Scan

Scanned2024-11-09T11:22:29+00:00
URL https://huernerhoefe.de/robots.txt
Redirect http://www.huernerhoefe.de/robots.txt
Redirect Domain www.huernerhoefe.de
Redirect Base huernerhoefe.de
Domain IPs 78.46.40.200
Redirect IPs 78.46.40.200
Response IP 78.46.40.200
Found Yes
Hash 6247db23b339aeaf95a473063ff6193774c8f4b23e9516464d1d1eb6fa73cfd5
SimHash ee4f7846cd61

Groups

*

Rule Path
Disallow /Impressum-Datenschutzhinweis.html

*

Rule Path
Disallow /Datenschutzerklaerung.html

*

Rule Path
Disallow /admin

*

Rule Path
Disallow /webalizer

*

Rule Path
Disallow /npwd.php

*

Rule Path
Disallow /usage2

*

Rule Path
Disallow /awstats

wget

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer pro

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

offline commander

Rule Path
Disallow /

leech

Rule Path
Disallow /

websnake

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

http weazel

Rule Path
Disallow /

Other Records

Field Value
sitemap sitemap.php