prosportovani.cz
robots.txt

Robots Exclusion Standard data for prosportovani.cz

Resource Scan

Scan Details

Site Domain prosportovani.cz
Base Domain prosportovani.cz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-20T11:06:05+00:00
Next Scan 2025-06-18T11:06:05+00:00

Last Successful Scan

Scanned2022-10-10T03:41:40+00:00
URL https://prosportovani.cz/robots.txt
Redirect https://www.prosportovani.cz/robots.txt
Redirect Domain www.prosportovani.cz
Redirect Base prosportovani.cz
Response IP 104.21.78.103, 172.67.220.56
Found Yes
Hash 45cc1c8bdee6010a8f6a669277e189815b85d1954f43328b6f86f157e949a029
SimHash 481cc962d713

Groups

*

Rule Path
Allow /*.css
Allow /*.js
Disallow /product/click-eshop/
Disallow /eshop-click/

seznambot
spbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

proximic

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

xenu link sleuth/1.3.8

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

kingkevinbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /
Disallow /admin/
Disallow /auth/

Other Records

Field Value
sitemap https://www.prosportovani.cz/clanky/sitemap_index.xml
sitemap https://www.prosportovani.cz/sitemap_index.xml
sitemap https://www.prosportovani.cz/sportoviste/sitemap_index.xml
sitemap https://www.prosportovani.cz/obchody/sitemap_index.xml

Warnings

  • `request-rate` is not a known field.