naturparkzentrum-gymnichermuehle.de
robots.txt

Robots Exclusion Standard data for naturparkzentrum-gymnichermuehle.de

Resource Scan

Scan Details

Site Domain naturparkzentrum-gymnichermuehle.de
Base Domain naturparkzentrum-gymnichermuehle.de
Scan Status Ok
Last Scan2024-09-06T15:17:23+00:00
Next Scan 2024-10-06T15:17:23+00:00

Last Scan

Scanned2024-09-06T15:17:23+00:00
URL https://naturparkzentrum-gymnichermuehle.de/robots.txt
Redirect https://www.naturparkzentrum-gymnichermuehle.de/robots.txt
Redirect Domain www.naturparkzentrum-gymnichermuehle.de
Redirect Base naturparkzentrum-gymnichermuehle.de
Domain IPs 176.28.16.30, 2a01:488:66:1000:b01c:101e:0:1
Redirect IPs 176.28.16.30, 2a01:488:66:1000:b01c:101e:0:1
Response IP 176.28.16.30
Found Yes
Hash 4f55b20d058de62d5597cef2da80e5ff8aa2e0e38e52be17a54e2564ae49cc8f
SimHash 0a135450e133

Groups

*

Rule Path
Disallow /fileadmin
Disallow /typo3
Disallow /typo3conf
Disallow /typo3temp
Disallow /typo3_src
Disallow /uploads
Allow /typo3/sysext/*/Resources/Public/

Other Records

Field Value
crawl-delay 300

aboundexbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blackbird

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

cms crawler

Rule Path
Disallow /

cmsworldmap.com

Rule Path
Disallow /

compspybot

Rule Path
Disallow /

crawlytics

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msrbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

nextgensearchbot

Rule Path
Disallow /

niki-bot

Rule Path
Disallow /

obot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

planetwork bot search

Rule Path
Disallow /

purebot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

sindicebot

Rule Path
Disallow /

snookbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

woobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.naturparkzentrum-gymnichermuehle.de/?type=1533906435

Warnings

  • 4 invalid lines.