malone.edu
robots.txt

Robots Exclusion Standard data for malone.edu

Resource Scan

Scan Details

Site Domain malone.edu
Base Domain malone.edu
Scan Status Ok
Last Scan2024-09-19T20:09:42+00:00
Next Scan 2024-10-19T20:09:42+00:00

Last Scan

Scanned2024-09-19T20:09:42+00:00
URL https://malone.edu/robots.txt
Redirect https://www.malone.edu/robots.txt
Redirect Domain www.malone.edu
Redirect Base malone.edu
Domain IPs 192.42.153.50, 2620:6d:c000:e154:3a19::50
Redirect IPs 192.42.153.50, 2620:6d:c000:e154:3a19::50
Response IP 192.42.153.50
Found Yes
Hash db0134a4e192e4d1fc22a0f94de03e33882a79673876a10adefa4c0d0fc7b88e
SimHash 69144d126337

Groups

*

Rule Path
Disallow /admin/

Comments

  • www.robotstxt.org/
  • Allow crawling of all content