hagertyagent.com
robots.txt

Robots Exclusion Standard data for hagertyagent.com

Resource Scan

Scan Details

Site Domain hagertyagent.com
Base Domain hagertyagent.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-26T14:07:14+00:00
Next Scan 2024-11-24T14:07:14+00:00

Last Successful Scan

Scanned2021-09-01T01:59:20+00:00
URL https://hagertyagent.com/robots.txt
Redirect https://www.hagertyagent.com/robots.txt
Redirect Domain www.hagertyagent.com
Redirect Base hagertyagent.com
Found Yes
Hash ac010b04a3067ea2e0d40427c00c78bcccaecdb9c410038cc63aa6b7c0b0b8e6
SimHash cb481d103b17

Groups

*

Rule Path
Disallow /Admin/
Disallow /bberry/
Disallow /Documents/
Disallow /DocumentTemp/
Disallow /Encompass/
Disallow /eRenewal/
Disallow /Images2Upload/
Disallow /LiveSupport/
Disallow /Pollmanager/
Disallow /SupApps/
Disallow /Temp/
Disallow /PrintApplication.asp
Disallow /lifestyle/eventdetail.aspx
Disallow /*.axd$
Disallow /design/designersReport.aspx
Disallow /qte/mobile/
Disallow /qte/quoteinput.aspx?aff=*
Disallow /*/sitecore/content/
Disallow /valuationtools/HVT/VehicleSearch/Report
Disallow /*/CaptchaImage.axd
Disallow /apps/QuoteMyClassic/
Disallow /apps/Resources/Chat/
Disallow /~/media/Images
Disallow /-/media/Images
Disallow /~/media/images
Disallow /-/media/images
Disallow /apps/manifold
Disallow /authenticate
Disallow /sc
Disallow /articles-videos/-/media/images
Disallow /articles-videos/~/media/images
Disallow /articles-videos/-/media/Images
Disallow /articles-videos/~/media/Images
Disallow /yourstories
Disallow /articles-videos/Featured-Classics/

deepcrawl

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.hagerty.com/sitemaps/sitemap.xml
sitemap https://www.hagerty.com/sitemaps/sitemap-usdirect.xml
sitemap https://www.hagerty.ca/sitemaps/sitemap-cadirect.xml
sitemap https://www.hagerty.com/media/sitemap_index.xml
sitemap https://www.hagerty.com/sitemaps/sitemap-ukdirect.xml
sitemap https://www.hagerty.com/apps/valuationtools/sitemap.xml
sitemap https://www.hagerty.ca/apps/valuationtools/sitemap.xml

Comments

  • robots.txt for both Direct and Agent web sites