Log In Sign Up

ssa.gov
robots.txt

Robots Exclusion Standard data for ssa.gov

Resource Scan

Scan Details

Site Domain ssa.gov
Base Domain ssa.gov
Scan Status Ok
Last Scan2024-05-15T14:22:43+00:00
Next Scan 2024-06-14T14:22:43+00:00

Last Scan

Scanned2024-05-15T14:22:43+00:00
URL https://ssa.gov/robots.txt
Redirect https://www.ssa.gov/robots.txt
Redirect Domain www.ssa.gov
Redirect Base ssa.gov
Domain IPs 137.200.39.19, 137.200.4.16, 2001:1930:d07::aaaa, 2001:1930:e03::aaaa
Redirect IPs 2600:1413:b000:1b::17d7:70e, 2600:1413:b000:1b::17d7:71a, 96.17.180.44, 96.17.180.51
Response IP 23.52.40.17
Found Yes
Hash 07d7a48fcb44aee2f07b6ddeb49782dc709198ee1c908449bce6ded84d21ed80
SimHash ed020145cbb4

Groups

*

Rule Path
Disallow /admin/
Disallow /cgi-bin/
Disallow /dev/
Disallow /hlp/
Disallow /info/
Disallow /javascript/
Disallow /myaccount/help/
Disallow /myaccount/materials/pdfs/SSA-7004.pdf
Disallow /onlineservices/eservices/
Disallow /ssaexpress/
Disallow /w3c/
Disallow /agency/shutdown/materials/contingency-plan-08-05-19.pdf
Disallow /agency/shutdown/materials/contingency-plan-08-05-19.html
Disallow /news/mip/
Disallow /menu/
Disallow /news/materials/pdfs/2023-psrw-letter.pdf
Back to top

Other Records

Field Value
sitemap https://www.ssa.gov/sitemap.xml
sitemap https://www.ssa.gov/sitemap1.xml
sitemap https://www.ssa.gov/search-gov/sitemap.xml
Back to top

Comments

  • www.ssa.gov robots.txt
  • 08/07/18
  • 08/06/19 added second sitemap
  • 09/25/20 added 2019 contingency plan PDF + html
  • Wayne Whitten
  • 11/08/22 added search-gov, and /menu/ for Beta launch
  • 5/5/23 added 2023-psrw-letter.pdf per Jira ticket
  • Disallow: /agency/shutdown/
Back to top