mirmay.com
robots.txt

Robots Exclusion Standard data for mirmay.com

Resource Scan

Scan Details

Site Domain mirmay.com
Base Domain mirmay.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-13T06:27:17+00:00
Next Scan 2024-10-11T06:27:17+00:00

Last Successful Scan

Scanned2023-09-18T04:05:27+00:00
URL https://mirmay.com/robots.txt
Redirect https://www.mirmay.com/robots.txt
Redirect Domain www.mirmay.com
Redirect Base mirmay.com
Domain IPs 66.254.114.123
Redirect IPs 66.254.114.123
Response IP 66.254.114.123
Found Yes
Hash 9c31aa8233f7e3472f370934811cee5b001df93f06aacb93fc1da4b936a38e87
SimHash b837430507d2

Groups

*

Rule Path
Disallow /stage/
Disallow /affiliate/

Comments

  • This robots.txt file requests that search engines and other
  • automated web-agents don't try to index the files in this
  • directory (/). This file is required in the event that you
  • use Revive Adserver without virtual domains (i.e. you use a
  • single URL to run both the admin interface and the delivery
  • engine), and have the web root set to this directory.