celebwiki.blesk.cz
robots.txt

Robots Exclusion Standard data for celebwiki.blesk.cz

Resource Scan

Scan Details

Site Domain celebwiki.blesk.cz
Base Domain blesk.cz
Scan Status Ok
Last Scan2024-10-04T21:55:05+00:00
Next Scan 2024-10-18T21:55:05+00:00

Last Scan

Scanned2024-10-04T21:55:05+00:00
URL https://celebwiki.blesk.cz/robots.txt
Domain IPs 104.26.0.127, 104.26.1.127, 172.67.71.132, 2606:4700:20::681a:17f, 2606:4700:20::681a:7f, 2606:4700:20::ac43:4784
Response IP 104.26.0.127
Found Yes
Hash cc3a6243b26955513551b973c5cb1b45f80d66716af3d0a60530ab05d49d130d
SimHash 791e8e70aa9a

Groups

*

Rule Path
Disallow /search
Disallow /videoConfig/*
Disallow /captcha/*
Disallow /Tag%2C*
Disallow /*?*nocache*
Disallow /*?*nocat*
Disallow /*?*__log*
Disallow /*?*mver*
Disallow /*.js*
Disallow /version.txt

ahrefsbot
ahrefssiteaudit
awariobot
blexbot
bytespider
criteobot
dataforseobot
dotbot
grapeshotcrawler
grapeshot
mj12bot
megaindex
mojeekbot
semrushbot
yandexbot
yeti
yisouspider

Rule Path
Disallow /

Other Records

Field Value
sitemap http://celebwiki.blesk.cz/sitemap-celebwiki.xml