Log In Sign Up

aarp.org
robots.txt

Robots Exclusion Standard data for aarp.org

Resource Scan

Scan Details

Site Domain aarp.org
Base Domain aarp.org
Scan Status Ok
Last Scan2024-05-10T22:13:22+00:00
Next Scan 2024-05-17T22:13:22+00:00

Last Scan

Scanned2024-05-10T22:13:22+00:00
URL https://aarp.org/robots.txt
Redirect https://www.aarp.org/robots.txt
Redirect Domain www.aarp.org
Redirect Base aarp.org
Domain IPs 45.60.152.55, 45.60.172.55
Redirect IPs 13.35.18.128, 13.35.18.25, 13.35.18.37, 13.35.18.81
Response IP 13.35.18.37
Found Yes
Hash c2bcfea1c87adfc16ae18bb2a2262e0afd4c3d6aae3bbf448f12137423f40314
SimHash a8e2ffc08d77

Groups

*

Rule Path
Disallow /*.pdf
Disallow /.4/
Disallow /.AARP/
Disallow /.br/
Disallow /.com/
Disallow /.Dev/
Disallow /.PARA/
Disallow /.Ver/
Disallow /benefits/
Disallow /content/aarpe/en/home/
Disallow /content/aarpe/en/home/vendor/
Disallow /content/aarpe/es/home/
Disallow /content/aarpe/es/home/vendor/
Disallow /content/campaigns/
Disallow /content/campaigns/aarp/master/user-states/
Disallow /content/dam/aarp/Member-Benefits/AARP-Auto-Buying-Program-For-Member-Communications-Digital-Fulfillment.pdf
Disallow /content/experience-fragments/
Disallow /content/experience-fragments/aarp/global/espanol/header/search-header-espanol/Target/_jcr_content/root/responsivegrid/experiencefragment.default.xf.html
Disallow /content/experience-fragments/aarp/global/header-xf/master/_jcr_content/root/responsivegrid/experiencefragment.default.xf.html
Disallow /content/experience-fragments/uxdia-folder-structure/en/features/rewards/authenticated-member-w-rewards/not-authenticated/_jcr_content/root/responsivegrid/experiencefragment.default.xf.html
Disallow /content/experience-fragments/aarp/vendor/acumen_wrapper/acumen-wrapper/master.footer.html
Disallow /content/experience-fragments/aarp/vendor/springboard-footer/advocacy-thin-footer.resource.root.html
Disallow /content/experience-fragments/fragments/hpHeader/headerTarget/_jcr_content/root/responsivegrid/experiencefragment.default.xf.html
Disallow /content/specialized-membership/staying-sharp/
Disallow /espanol/busqueda/
Disallow /espanol/vendor/
Disallow /everywhere/
Disallow /everywhere-configuration/
Disallow /playground-for-testing-stuff/
Disallow /qa/
Disallow /relationships/caregiving/
Disallow /search/
Disallow /secure-information/
Disallow /training-aarpe/
Disallow /vendor/

gptbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.aarp.org/sitemap.xml
Back to top

Comments

  • _____ _____
  • /\ /\ | __ \ | __ \
  • / \ / \ | |__) | | |__) |
  • / /\ \ / /\ \ | _ / | ___/
  • / ____ \ / ____ \ | | \ \ | |
  • /_/ \_\ /_/ \_\ |_| \_\ |_|
  • Robots.txt file created by https://www.aarp.org/
  • For domain: https://www.aarp.org/
  • Created 09-12-2017 Raymond Deschenes
  • Updated 5-09-2024 Kasia Lorenc - removed /benefits-discounts/
  • All robots will spider the domain
Back to top