Log In Sign Up

healthsherpa.com
robots.txt

Robots Exclusion Standard data for healthsherpa.com

Resource Scan

Scan Details

Site Domain healthsherpa.com
Base Domain healthsherpa.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-22T12:21:23+00:00
Next Scan 2024-09-20T12:21:23+00:00

Last Successful Scan

Scanned2023-05-03T13:10:06+00:00
URL https://healthsherpa.com/robots.txt
Response IP 54.160.89.172
Found Yes
Hash 17b8e93a079f09e25f78da0ae5ce815f3eb6e8a81b1c4a54e44daf1d012c9602
SimHash ce5a7d273146

Groups

*

Rule Path
Disallow /managed_applications/

velenpublicwebcrawler

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://www.healthsherpa.com/sitemap.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/CA.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/CO.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/CT.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/DC.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/ID.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/NY.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/VT.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/MN.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/RI.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/WA.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/KY.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/MD.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/MA.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/FL.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/AL.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/AK.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/AZ.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/AR.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/DE.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/GA.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/HI.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/IL.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/IN.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/IA.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/KS.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/LA.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/ME.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/MI.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/MS.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/MO.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/MT.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/NE.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/NV.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/NH.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/NJ.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/NM.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/NC.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/ND.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/OH.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/OK.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/OR.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/PA.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/SC.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/SD.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/TN.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/TX.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/UT.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/VA.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/WV.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/WI.xml
sitemap http://www.healthsherpa.com/state_plans_sitemap/WY.xml
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /
Back to top