jidlo.cz
robots.txt

Robots Exclusion Standard data for jidlo.cz

Resource Scan

Scan Details

Site Domain jidlo.cz
Base Domain jidlo.cz
Scan Status Ok
Last Scan2024-06-27T09:26:19+00:00
Next Scan 2024-07-04T09:26:19+00:00

Last Scan

Scanned2024-06-27T09:26:19+00:00
URL https://jidlo.cz/robots.txt
Domain IPs 178.162.212.139
Response IP 178.162.212.139
Found Yes
Hash e0d19e921b881d57e7a9e5d4381b19b2582d9f8fdc1ee3d383007a3873babb3f
SimHash 636998452633

Groups

gptbot

Rule Path
Disallow /

ttd-content

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /.

ezooms

Rule Path
Disallow /.

sistrix

Rule Path
Disallow /

yandex

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

ias_crawler

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

sklikbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /tmp
Disallow /modules
Disallow /lib/
Allow /

Other Records

Field Value
sitemap https://www.jidlo.cz/sitemaptips.xml
sitemap https://www.jidlo.cz/sitemapaatips.xml

Warnings

  • 1 invalid line.