levne-ceny.cz
robots.txt

Robots Exclusion Standard data for levne-ceny.cz

Resource Scan

Scan Details

Site Domain levne-ceny.cz
Base Domain levne-ceny.cz
Scan Status Ok
Last Scan2024-09-29T10:34:03+00:00
Next Scan 2024-10-29T10:34:03+00:00

Last Scan

Scanned2024-09-29T10:34:03+00:00
URL https://levne-ceny.cz/robots.txt
Redirect https://www.levne-ceny.cz/robots.txt
Redirect Domain www.levne-ceny.cz
Redirect Base levne-ceny.cz
Domain IPs 142.132.183.123, 2a01:4f8:c012:78a5::1
Redirect IPs 142.132.183.123, 2a01:4f8:c012:78a5::1
Response IP 142.132.183.123
Found Yes
Hash 113f309aed76818bdcb7344c77e3c529b1f0d5bc55a5c6cf0da1f9575a275195
SimHash 5e6fde0aed32

Groups

yandex

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

lcc

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow
Disallow /exit/*

Other Records

Field Value
sitemap https://www.levne-ceny.cz/sitemap.xml