mrk.cz
robots.txt

Robots Exclusion Standard data for mrk.cz

Resource Scan

Scan Details

Site Domain mrk.cz
Base Domain mrk.cz
Scan Status Ok
Last Scan2024-10-04T14:59:10+00:00
Next Scan 2024-10-11T14:59:10+00:00

Last Scan

Scanned2024-10-04T14:59:10+00:00
URL https://mrk.cz/robots.txt
Domain IPs 89.185.255.248
Response IP 89.185.255.248
Found Yes
Hash fa40d3bed3e8bdd345cea8ee47db663481363a47213284d5d9c9b72b83cd9c9e
SimHash 6ff2d834a307

Groups

*

Rule Path
Disallow /LIB
Disallow /download
Disallow /Admin
Disallow /video
Disallow /stat_view.php3
Disallow /bazar_del.php3
Disallow /bazar_edit.php3
Disallow /cleni_seznam.php3
Disallow /clen.php3
Disallow /cleni_new.php3
Disallow /cleni_del.php3
Disallow /clen_fotky.php3
Disallow /all_inserts.php3
Disallow /oznamkuj.php3
Disallow /hlasuj.php3
Disallow /adv.php3
Disallow /obchody_go.php3
Disallow /live.php3
Disallow /tackle_form.php3
Disallow /search.php3
Disallow /libise.php
Disallow /poznamky.php
Disallow /ajax-userlist.php
Disallow /ajax-poc-kom.php
Disallow /ajax-nicks.php
Disallow /ajax-getzapis.php
Disallow /add_nick.php
Allow /clen.php3?id=44
Allow /clen.php3?id=90
Allow /Data/Fotky
Allow /Data/Galerie
Allow /Data/Knihovna
Allow /Data/NejNej
Allow /Data/Reviry
Allow /Data/news.xml
Allow /Data/Zbozi
Allow /Data/Prodejny
Allow /Data/Pruvodce
Allow /Data/Tackle
Allow /Data/Zavody
Allow /Data/Pics
Allow /LIB/*.js

Other Records

Field Value
crawl-delay 1

machinelearning

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mrk.cz/google-sitemap.php

Warnings

  • `request-rate` is not a known field.