Log In Sign Up

menil.org
robots.txt

Robots Exclusion Standard data for menil.org

Resource Scan

Scan Details

Site Domain menil.org
Base Domain menil.org
Scan Status Ok
Last Scan2024-04-30T04:06:47+00:00
Next Scan 2024-05-30T04:06:47+00:00

Last Scan

Scanned2024-04-30T04:06:47+00:00
URL https://menil.org/robots.txt
Redirect https://www.menil.org/robots.txt
Redirect Domain www.menil.org
Redirect Base menil.org
Domain IPs 3.214.243.246
Redirect IPs 3.220.57.224, 3.232.242.170, 52.20.78.240, 54.91.59.199
Response IP 54.91.59.199
Found Yes
Hash e008c36019de785c27cd2f77fa393f506493cecb89f266e856b969a45089ab60
SimHash ba852d8d7750

Groups

*

Rule Path
Disallow /search
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top