t-shock.eu
robots.txt

Robots Exclusion Standard data for t-shock.eu

Resource Scan

Scan Details

Site Domain t-shock.eu
Base Domain t-shock.eu
Scan Status Ok
Last Scan2024-10-02T15:27:41+00:00
Next Scan 2024-11-01T15:27:41+00:00

Last Scan

Scanned2024-10-02T15:27:41+00:00
URL https://t-shock.eu/robots.txt
Redirect https://www.t-shock.eu/robots.txt
Redirect Domain www.t-shock.eu
Redirect Base t-shock.eu
Domain IPs 88.86.106.49
Redirect IPs 88.86.106.49
Response IP 88.86.106.49
Found Yes
Hash 7116d91d8efe716ad35d084d7be0045af92c8560f6427b1a4a6cf9c7c96181e7
SimHash 581cd1526280

Groups

*

Rule Path
Allow /
Disallow /muj-ucet/
Disallow /moj-ucet/
Disallow /SklademVelikost
Disallow /druhXML
Disallow /scripts/
Disallow /cssshop/
Disallow /styly/
Disallow utm_

Other Records

Field Value
crawl-delay 10

seznambot
mj12bot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

nimbostratus-bot/v1.3.2

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

semrushbot/6~bl

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

trident/7.0

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.t-shock.eu/sitemapindex.xml

Warnings

  • 3 invalid lines.
  • `request-rate` is not a known field.