Log In Sign Up

aarpdriversafety.org
robots.txt

Robots Exclusion Standard data for aarpdriversafety.org

Resource Scan

Scan Details

Site Domain aarpdriversafety.org
Base Domain aarpdriversafety.org
Scan Status Ok
Last Scan2024-10-26T16:15:34+00:00
Next Scan 2024-11-25T16:15:34+00:00

Last Scan

Scanned2024-10-26T16:15:34+00:00
URL https://aarpdriversafety.org/robots.txt
Redirect https://www.aarpdriversafety.org:443/robots.txt
Redirect Domain www.aarpdriversafety.org
Redirect Base aarpdriversafety.org
Domain IPs 18.211.140.185, 3.215.24.102, 52.54.59.50
Redirect IPs 3.167.212.101, 3.167.212.129, 3.167.212.4, 3.167.212.79
Response IP 13.226.2.9
Found Yes
Hash 373439b478e4c2d3ed8257db9d72129c00704ab1a207b35f6541ebc15ecaecf4
SimHash 88fefd510d50

Groups

*

Rule Path
Disallow /*.pdf
Disallow /support/
Disallow /login/
Disallow /login
Disallow /login.html
Back to top

Other Records

Field Value
sitemap https://www.aarpdriversafety.org/sitemap.xml
Back to top

Comments

  • ____ _ ____ __ _
  • | _ \ _ __ (_) __ __ ___ _ __ / ___| __ _ / _| ___ | |_ _ _
  • | | | | | '__| | | \ \ / / / _ \ | '__| \___ \ / _` | | |_ / _ \ | __| | | | |
  • | |_| | | | | | \ V / | __/ | | ___) | | (_| | | _| | __/ | |_ | |_| |
  • |____/ |_| |_| \_/ \___| |_| |____/ \__,_| |_| \___| \__| \__, |
  • |___/
  • Robots.txt file created by https://www.aarp.org/
  • For domain: https://www.aarpdriversafety.org/
  • Updated 07-19-2024 Brandon Fleming – Removal of legacy rules
  • All robots will spider the domain
Back to top