testo.com
robots.txt

Robots Exclusion Standard data for testo.com

Resource Scan

Scan Details

Site Domain testo.com
Base Domain testo.com
Scan Status Ok
Last Scan2024-06-20T18:00:19+00:00
Next Scan 2024-07-20T18:00:19+00:00

Last Scan

Scanned2024-06-20T18:00:19+00:00
URL https://testo.com/robots.txt
Redirect https://www.testo.com/robots.txt
Redirect Domain www.testo.com
Redirect Base testo.com
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.22, 76.76.21.93
Response IP 76.76.21.61
Found Yes
Hash bc73e96818516e2ad9db0a3b45bf11a7408dbfb2d47d615f6c2e5c26d19ad59d
SimHash fa2c7414dff1

Groups

*

Rule Path
Disallow /en/3rdParty/
Disallow /en/applications/
Disallow /en/company/
Disallow /en/contact/
Disallow /en/dl/
Disallow /en/downloads/
Disallow /en/howto/
Disallow /en/legal/
Disallow /en/login/
Disallow /en/partner/
Disallow /en/products/
Disallow /en/promotion/
Disallow /en/qr
Disallow /en/service/
Disallow /en/services/
Disallow /en/shared-content/
Disallow /en/videos/
Disallow /es/3rdParty/
Disallow /es/applications/
Disallow /es/Company/
Disallow /es/contact/
Disallow /es/dl/
Disallow /es/downloads/
Disallow /es/legal/
Disallow /es/login/
Disallow /es/Partner/
Disallow /es/products/
Disallow /es/promotion/
Disallow /es/services/
Disallow /es/shared-content/
Disallow /es/videos/
Disallow /de/3rdParty/
Disallow /de/applications/
Disallow /de/company/
Disallow /de/contact/
Disallow /de/dl/
Disallow /de/downloads/
Disallow /de/legal/
Disallow /de/login/
Disallow /de/Partner/
Disallow /de/products/
Disallow /de/promotion/
Disallow /de/service/
Disallow /de/services/
Disallow /de/shared-content/
Disallow /de/unternehmen/
Disallow /de/videos/
Disallow /fr/3rdParty/
Disallow /fr/applications/
Disallow /fr/company/
Disallow /fr/contact/
Disallow /fr/dl/
Disallow /fr/downloads/
Disallow /fr/legal/
Disallow /fr/login/
Disallow /fr/Partner/
Disallow /fr/products/
Disallow /fr/promotion/
Disallow /fr/services/
Disallow /fr/shared-content/
Disallow /fr/videos/
Disallow /*?*q=
Disallow /*.pdf$

cazoodlebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot/1.0

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.testo.com/sitemap.xml

Comments

  • Allow search crawlers to discover the sitemap
  • Block CazoodleBot as it does not present correct accept content headers
  • Block MJ12bot as it is just noise
  • Block dotbot as it cannot parse base urls properly
  • Block Gigabot