csnn.eu
robots.txt

Robots Exclusion Standard data for csnn.eu

Resource Scan

Scan Details

Site Domain csnn.eu
Base Domain csnn.eu
Scan Status Ok
Last Scan2025-06-06T09:19:57+00:00
Next Scan 2025-06-20T09:19:57+00:00

Last Scan

Scanned2025-06-06T09:19:57+00:00
URL https://csnn.eu/robots.txt
Redirect https://www.csnn.eu/robots.txt
Redirect Domain www.csnn.eu
Redirect Base csnn.eu
Domain IPs 185.64.216.251
Redirect IPs 185.64.216.251
Response IP 185.64.216.251
Found Yes
Hash 4c405db5ab3428482546929e843132648d8112a13e355762d0505b0b04665d12
SimHash c038dc888da2

Groups

ahrefsbot
andjing
aperture
arachnid
arale
aspeek
bixo
capek
ccrawler
crawwwler
dataparksearch
distributed web crawler
dotbot
ebot
gnu wget
grub
heritrix
hounder
ht://dig
hyper estraier
hyperspider
icdl crawler
icrawler
jobo
larm
metis
mj12bot
mnogosearch
nodecrawler
norconex http collector
nutch
openwebspider
opese
pavuk
petalbot/aspiegelbot
php-crawler
pycreep
pyspider
scrapy
semrushbot
sphider
stormcrawler
web harvest
webeater
weblech
websphinx
xapian
yacy

Rule Path
Disallow /

*

Rule Path
Disallow /admin
Disallow /prihlaseni
Disallow /registrace
Disallow /clanek-poslat
Disallow /clanek-pdf
Disallow /url_ext
Disallow /3366681

mediapartners-google

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.csnn.eu/sitemap.xml