mohela.studentaid.gov
robots.txt

Robots Exclusion Standard data for mohela.studentaid.gov

Resource Scan

Scan Details

Site Domain mohela.studentaid.gov
Base Domain studentaid.gov
Scan Status Ok
Last Scan2024-11-03T07:09:34+00:00
Next Scan 2024-12-03T07:09:34+00:00

Last Scan

Scanned2024-11-03T07:09:34+00:00
URL https://mohela.studentaid.gov/robots.txt
Domain IPs 2600:1413:b000:6::17d5:2bc7, 2600:1413:b000:6::17d5:2bce, 96.17.96.11, 96.17.96.13
Response IP 23.50.232.235
Found Yes
Hash aa024aa7071b18edd9c51a8ae423a03f9834a8180300cdc311a425c7b26c6fc1
SimHash a80ceba2f21a

Groups

*

Rule Path
Disallow /DL/secure/
Disallow /DL/common/publicinfo/

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

startmebot

Rule Path
Disallow /

org_bot

Rule Path
Disallow /