cdn.aarp.net
robots.txt

Robots Exclusion Standard data for cdn.aarp.net

Resource Scan

Scan Details

Site Domain cdn.aarp.net
Base Domain aarp.net
Scan Status Ok
Last Scan2024-05-18T00:10:14+00:00
Next Scan 2024-05-25T00:10:14+00:00

Last Scan

Scanned2024-05-18T00:10:14+00:00
URL https://cdn.aarp.net/robots.txt
Domain IPs 18.155.68.111, 18.155.68.115, 18.155.68.120, 18.155.68.79
Response IP 18.155.68.111
Found Yes
Hash 866dcad85d68897c00cffbd6b07fa2fb371c10b334fc5d6c772ace0273309403
SimHash a33697a05b87

Groups

*

Rule Path
Allow /*.jpg
Allow /*.png
Allow /*.ico
Disallow /

gptbot

Rule Path
Disallow /

Comments

  • Robots.txt file created by https://cdn.aarp.net/
  • Created 10-18-2021 by Bill Cushing Updated 11-27-2023 by Kasia Lorenc
  • No changes to this file permitted without approval
  • No robots will spider the domain - Updated to allow image path references