disrupter.refresher.cz
robots.txt

Robots Exclusion Standard data for disrupter.refresher.cz

Resource Scan

Scan Details

Site Domain disrupter.refresher.cz
Base Domain refresher.cz
Scan Status Ok
Last Scan2025-09-28T13:38:04+00:00
Next Scan 2025-10-12T13:38:04+00:00

Last Scan

Scanned2025-09-28T13:38:04+00:00
URL https://disrupter.refresher.cz/robots.txt
Domain IPs 104.26.2.111, 104.26.3.111, 172.67.70.154, 2606:4700:20::681a:26f, 2606:4700:20::681a:36f, 2606:4700:20::ac43:469a
Response IP 104.26.3.111
Found Yes
Hash 784a63027a756f6014def903d20e5187e1404d067f58950b05fee3284474c233
SimHash 681d0d077c08

Groups

*

Rule Path
Disallow /nahlasit-obsah
Disallow /set-lang
Disallow /services
Disallow /vyhladavanie
Disallow /cdn-cgi/
Disallow /ajx/
Disallow /prihlaseni

mediaboardbot

Rule Path
Disallow /profil/

seznambot

Rule Path
Disallow /profil/

bingbot

Rule Path
Disallow /profil/

ahrefsbot

Rule Path
Disallow /profil/

dotbot

Rule Path
Disallow /profil/

blexbot

Rule Path
Disallow /profil/

semrushbot

Rule Path
Disallow /profil/

mj12bot

Rule Path
Disallow /profil/

sentibot

Rule Path
Disallow /profil/

claudebot

Rule Path
Disallow /profil/

Other Records

Field Value
sitemap https://refresher.cz/sitemap/news.xml
sitemap https://refresher.cz/sitemap/index.xml