mnhn.lu
robots.txt

Robots Exclusion Standard data for mnhn.lu

Resource Scan

Scan Details

Site Domain mnhn.lu
Base Domain mnhn.lu
Scan Status Ok
Last Scan2024-09-21T01:41:44+00:00
Next Scan 2024-10-21T01:41:44+00:00

Last Scan

Scanned2024-09-21T01:41:44+00:00
URL https://mnhn.lu/robots.txt
Domain IPs 158.64.59.231
Response IP 158.64.59.231
Found Yes
Hash 80ac2fb4c3464b800479ecedacd159c83d4a4d7b0c3861744ed1373d290fe2ac
SimHash 4844d9815675

Groups

*

Rule Path
Disallow /

googlebot
googlebot-image
mediapartners-google
bingbot
bing
msnbot
msnbot-media
yahoo-blogs
yahoo-mmcrawler

Rule Path
Disallow /wp-login.php

Other Records

Field Value
crawl-delay 10

twitterbot

Rule Path
Disallow /wp-login.php

slurp

Rule Path
Disallow /wp-login.php

Other Records

Field Value
crawl-delay 10

Comments

  • disallow all
  • but allow only important bots