Log In Sign Up

stayingsharp.aarp.org
robots.txt

Robots Exclusion Standard data for stayingsharp.aarp.org

Resource Scan

Scan Details

Site Domain stayingsharp.aarp.org
Base Domain aarp.org
Scan Status Ok
Last Scan2024-05-10T10:52:44+00:00
Next Scan 2024-06-09T10:52:44+00:00

Last Scan

Scanned2024-05-10T10:52:44+00:00
URL https://stayingsharp.aarp.org/robots.txt
Domain IPs 108.156.133.36, 108.156.133.55, 108.156.133.93, 108.156.133.95
Response IP 108.156.133.55
Found Yes
Hash 0081a25345b954faf65ff14b9b8548faff374fce624d1d6f75ed36863aa379f2
SimHash 914f1f41c114

Groups

*

Rule Path
Disallow /*_jcr_content
Disallow /*jcr%3Acontent
Disallow /about/vendor/
Disallow /content/campaigns/
Disallow /content/campaigns/staying-sharp/master/staying-sharp-user-activity/
Disallow /content/dam/specialized-membership/staying-sharp/staying-sharp-about/brain-health/snackable/bh101/200355-AARP-BrainHealth101Challenge-SnackableWorkbook_FNL.pdf
Disallow /content/dam/specialized-membership/staying-sharp/staying-sharp-homepage/htttyd/210127-ARPSS-Talk%20to%20your%20dr%20companion%20guide_v8.pdf
Disallow /content/dam/specialized-membership/staying-sharp/staying-sharp-homepage/supplements/200217-SS-Infographics-VitaminPDF-R2.pdf
Disallow /content/staying-sharp/en/home/about/work-with-us/_jcr_content/par/backgroundparsys/bg-parsys/aemform.iframe.html?dataRef=&wcmmode=DISABLED
Disallow /content/staying-sharp/en/home/games-play/full-of-blanks/_jcr_content/par/padding.default.html
Disallow /etc/

gptbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://stayingsharp.aarp.org/sitemap.xml
Back to top

Comments

  • Robots.txt file created by https://www.aarp.org/
  • For sub-domain: https://stayingsharp.aarp.org/
  • Updated 08-12-2021 Raymond Deschenes - PDFs and Fragments
  • All robots will spider the domain
Back to top