teksavvy.com
robots.txt

Robots Exclusion Standard data for teksavvy.com

Resource Scan

Scan Details

Site Domain teksavvy.com
Base Domain teksavvy.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-09-23T10:19:23+00:00
Next Scan 2024-11-22T10:19:23+00:00

Last Successful Scan

Scanned2024-07-03T10:17:28+00:00
URL https://teksavvy.com/robots.txt
Redirect https://www.teksavvy.com/robots.txt
Redirect Domain www.teksavvy.com
Redirect Base teksavvy.com
Domain IPs 20.116.31.67
Redirect IPs 20.116.31.67
Response IP 20.116.31.67
Found Yes
Hash 71394081412c713c6c87f22d3d339f88c603e2d399c17adb301bbb236ed27ec3
SimHash 4800e846cd17

Groups

gptbot
ccbot

Rule Path
Disallow /

*

Rule Path
Allow /

*

Rule Path
Disallow /services/internet/hardware
Disallow /fr/nos-services/internet/equipement
Disallow /404.php
Disallow /500.php

Other Records

Field Value
sitemap https://www.teksavvy.com/sitemap.xml

Comments

  • General rules for Crawlers
  • Rules for individual pages
  • Sitemap location