mines.edu
robots.txt

Robots Exclusion Standard data for mines.edu

Resource Scan

Scan Details

Site Domain mines.edu
Base Domain mines.edu
Scan Status Ok
Last Scan2024-10-25T14:52:49+00:00
Next Scan 2024-11-24T14:52:49+00:00

Last Scan

Scanned2024-10-25T14:52:49+00:00
URL https://mines.edu/robots.txt
Redirect https://www.mines.edu/robots.txt
Redirect Domain www.mines.edu
Redirect Base mines.edu
Domain IPs 141.193.213.10, 141.193.213.11
Redirect IPs 141.193.213.10, 141.193.213.11
Response IP 141.193.213.10
Found Yes
Hash d3e1c4af952433c8056b44bcb186b691bdca6a619f21903ac2a268e0ba9821df
SimHash 6ba04cc0a2b2

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-content/uploads/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60