preventivevet.com
robots.txt

Robots Exclusion Standard data for preventivevet.com

Resource Scan

Scan Details

Site Domain preventivevet.com
Base Domain preventivevet.com
Scan Status Ok
Last Scan2024-06-11T20:52:32+00:00
Next Scan 2024-06-18T20:52:32+00:00

Last Scan

Scanned2024-06-11T20:52:32+00:00
URL https://preventivevet.com/robots.txt
Redirect https://www.preventivevet.com/robots.txt
Redirect Domain www.preventivevet.com
Redirect Base preventivevet.com
Domain IPs 199.60.103.135, 199.60.103.35
Redirect IPs 199.60.103.227, 199.60.103.29, 2606:2c40::c73c:671d, 2606:2c40::c73c:67e3
Response IP 199.60.103.29
Found Yes
Hash a4de7e811aeeb824d211c806c9151c7c996d8a0357688241eec8f2878213a88a
SimHash 38c64f0a4ef2

Groups

hubspotcontentsearchbot

Rule Path
Disallow /veterinary/*
Disallow /dogtrainers/*
Disallow /dog-training-behavior
Disallow /dog-grooming-articles
Disallow /dog-health-safety
Disallow /cat-health-safety
Disallow /cat-behavior-enrichment
Disallow /cat-grooming-articles
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/

*

Rule Path
Disallow /dogs/topic/*
Disallow /dogs/author/*
Disallow /cats/topic/*
Disallow /cats/author/*
Disallow /pets/topic/*
Disallow /pets/author/*
Disallow /pawsandplay/topic/*
Disallow /pawsandplay/author/*
Disallow /tailwind/*
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/

Other Records

Field Value
sitemap https://www.preventivevet.com/sitemap.xml

Comments

  • Block just HubSpot Site Search Indexing
  • Rules for all other search bots including Google