ecommercemeter.com
robots.txt

Robots Exclusion Standard data for ecommercemeter.com

Resource Scan

Scan Details

Site Domain ecommercemeter.com
Base Domain ecommercemeter.com
Scan Status Ok
Last Scan2026-01-04T19:01:11+00:00
Next Scan 2026-01-11T19:01:11+00:00

Last Scan

Scanned2026-01-04T19:01:11+00:00
URL https://ecommercemeter.com/robots.txt
Domain IPs 51.38.67.129
Response IP 51.38.67.129
Found Yes
Hash def3727055b7ebcd27521e17ecaf3b5552bcf763ecc7644cfa0a63f4afa711b1
SimHash 401c9f72fa11

Groups

*

Rule Path
Allow /
Allow /privacy-policy.html
Allow /terms-of-service.html
Allow /disclaimer.html

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

openai

Rule Path
Disallow /

bard

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Disallow /visits.dat
Disallow /*.log
Disallow /tmp/
Disallow /cache/
Disallow /backup/
Disallow /.htaccess
Disallow /lang.php

Other Records

Field Value
crawl-delay 10

Comments

  • Blokovat AI boty a scrapery
  • Blokovat citlivé soubory
  • Crawl delay
  • Sitemap - dynamicky generováno
  • Sitemap: [DYNAMIC_DOMAIN]/sitemap.xml