sas-itec.com
robots.txt

Robots Exclusion Standard data for sas-itec.com

Resource Scan

Scan Details

Site Domain sas-itec.com
Base Domain sas-itec.com
Scan Status Ok
Last Scan2025-08-13T10:18:57+00:00
Next Scan 2025-09-12T10:18:57+00:00

Last Scan

Scanned2025-08-13T10:18:57+00:00
URL https://sas-itec.com/robots.txt
Redirect https://www.sas-itec.com/robots.txt
Redirect Domain www.sas-itec.com
Redirect Base sas-itec.com
Domain IPs 2001:41d0:301::100, 5.135.23.164
Redirect IPs 2001:41d0:301::100, 5.135.23.164
Response IP 5.135.23.164
Found Yes
Hash 1bfddb1905ce478110fb90886ca8ae4bd56660502d75c9db9a15d5825b02a8f0
SimHash 7b37d854c1b1

Groups

aa-site-audit-crawler

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ravencrawler

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

*

Rule Path
Disallow /_cron/
Disallow /_exchange/
Disallow /_reseller/
Disallow /admin/
Disallow /css/
Disallow /custom/
Disallow /gabarits/
Disallow /js/
Disallow /library/
Disallow /modules/
Disallow /eshop.htm
Disallow /eshop-*.htm
Disallow /mon-compte.htm
Disallow /mon-panier.htm
Disallow /recherche.htm
Disallow /404.htm

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.sas-itec.com/sitemap.xml

Comments

  • AUTRES BOTS
  • RALENTIR LES ROBOTS : TEMPS ENTRE 2 REQUETES EN SECONDES
  • DESACTIVER CERTAINES PAGES

Warnings

  • `noindex` is not a known field.