Log In Sign Up

ctg.com
robots.txt

Robots Exclusion Standard data for ctg.com

Resource Scan

Scan Details

Site Domain ctg.com
Base Domain ctg.com
Scan Status Ok
Last Scan2025-08-27T16:19:35+00:00
Next Scan 2025-09-26T16:19:35+00:00

Last Scan

Scanned2025-08-27T16:19:35+00:00
URL https://ctg.com/robots.txt
Redirect https://www.ctg.com/robots.txt
Redirect Domain www.ctg.com
Redirect Base ctg.com
Domain IPs 172.66.40.200, 172.66.43.56, 2606:4700:3108::ac42:28c8, 2606:4700:3108::ac42:2b38
Redirect IPs 172.66.40.200, 172.66.43.56, 2606:4700:3108::ac42:28c8, 2606:4700:3108::ac42:2b38
Response IP 172.66.43.56
Found Yes
Hash 8643d1f2ba624f33e420cf036dbd413248679542e43978c5b7470f7a4aeb1db7
SimHash 3a3ccaf0c183

Groups

*

Rule Path
Disallow /email-preferences/
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /thank-you/
Disallow /unsubscribe/
Disallow /search/
Disallow /404/
Disallow /*?*utm_*
Disallow /*?*hsLang=*
Disallow /*?*hs_preview=*
Disallow /hs/preferences-center/
Disallow /*?*hsCacheBuster=*

hubspotcontentsearchbot

Rule Path
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*
Back to top

Other Records

Field Value
sitemap https://www.ctg.com/sitemap.xml
Back to top

Comments

  • Main configuration
  • Sitemap location
  • Latest update 20260610
  • Block common unwanted pages/directories
Back to top