hqafsa.org
robots.txt

Robots Exclusion Standard data for hqafsa.org

Resource Scan

Scan Details

Site Domain hqafsa.org
Base Domain hqafsa.org
Scan Status Ok
Last Scan2025-09-18T22:41:11+00:00
Next Scan 2025-10-18T22:41:11+00:00

Last Scan

Scanned2025-09-18T22:41:11+00:00
URL https://hqafsa.org/robots.txt
Redirect https://www.hqafsa.org/robots.txt
Redirect Domain www.hqafsa.org
Redirect Base hqafsa.org
Domain IPs 199.34.228.70
Redirect IPs 199.34.228.70
Response IP 199.34.228.70
Found Yes
Hash 348b1e6793d3e07835987c1cbcabadcfcaaa838ba9778b692ec40088f86af578
SimHash f044cc140ff2

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /family-friends-images.html
Disallow /https%3A//members.hqafsa.org/Shared_Content/Sign_In.aspx
Disallow /key-legislation.html
Disallow /leaders-mentor-leaders.html
Disallow /edconnect-guard-reserve.html
Disallow /autorenew.html
Disallow /legislative-action-center.html
Disallow /budget-blog.html
Disallow /6/
Disallow /budget-blog/
Disallow /budget-blog
Disallow /familymatters-902094.html
Disallow /https%3A//members.hqafsa.org/Members_AFSA/Resources/MagazineSubscription.aspx
Disallow /buddypass.html
Disallow /familyfriendstrong-141184-856900.html
Disallow /reward-the-recruiters.html
Disallow /united-in-strength.html
Disallow /1plus2.html
Disallow /e1-e4-special.html
Disallow /m4life2.html
Disallow /familyfocus.html
Disallow /familyfriendstrong.html
Disallow /familyfocus-358787.html
Disallow /https%3A//members.hqafsa.org/Shared_Content/ContactManagement/Sign_In_CA.aspx
Disallow /afsapac2020-hold.html
Disallow /milgov-relations.html

Other Records

Field Value
sitemap https://www.hqafsa.org/sitemap.xml