preventivevet.com
robots.txt

Robots Exclusion Standard data for preventivevet.com

Resource Scan

Scan Details

Site Domain preventivevet.com
Base Domain preventivevet.com
Scan Status Ok
Last Scan2024-11-12T23:56:44+00:00
Next Scan 2024-11-19T23:56:44+00:00

Last Scan

Scanned2024-11-12T23:56:44+00:00
URL https://preventivevet.com/robots.txt
Redirect https://www.preventivevet.com/robots.txt
Redirect Domain www.preventivevet.com
Redirect Base preventivevet.com
Domain IPs 199.60.103.135, 199.60.103.35
Redirect IPs 199.60.103.227, 199.60.103.29, 2606:2c40::c73c:671d, 2606:2c40::c73c:67e3
Response IP 199.60.103.29
Found Yes
Hash 65af2f8c98194ea9f8dbd5048aab149d17566862465f180f4ae116a3545f2713
SimHash 38ce4f0b46b3

Groups

hubspotcontentsearchbot

Rule Path
Disallow /veterinary/*
Disallow /dogtrainers/*
Disallow /dog-training-behavior
Disallow /dog-grooming-articles
Disallow /dog-health-safety
Disallow /cat-health-safety
Disallow /cat-behavior-enrichment
Disallow /cat-grooming-articles
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

*

Rule Path
Disallow /dogs/topic/*
Disallow /dogs/author/*
Disallow /cats/topic/*
Disallow /cats/author/*
Disallow /pets/topic/*
Disallow /pets/author/*
Disallow /pawsandplay/topic/*
Disallow /pawsandplay/author/*
Disallow /tailwind/*
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

Other Records

Field Value
sitemap https://www.preventivevet.com/sitemap.xml

Comments

  • Block just HubSpot Site Search Indexing
  • Rules for all other search bots including Google