www.turiec.turistickenoviny.sk
robots.txt
Robots Exclusion Standard data for www.turiec.turistickenoviny.sk
Resource Scan
Scan Details
Site Domain | www.turiec.turistickenoviny.sk |
Base Domain | turistickenoviny.sk |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-09-17T06:59:47+00:00 |
Next Scan | 2024-12-16T06:59:47+00:00 |
Last Successful Scan
Scanned | 2024-01-29T02:19:40+00:00 |
URL | https://www.turiec.turistickenoviny.sk/robots.txt |
Domain IPs | 87.197.112.64 |
Response IP | 87.197.112.64 |
Found | Yes |
Hash | 0d83937c1e00dd438ea8dbd0b6e96eca2b0faa6c74f1b943f655710cbb91aecc |
SimHash | 996cc4626031 |
Groups
ahrefsbot
mozilla/5.0 (compatible; ahrefsbot/5.2; +http://ahrefs.com/robot/)
barkrowler
barkrowler/0.7 (+http://www.exensa.com/crawl)
mozilla/5.0 (compatible; 007ac9 crawler; http://crawler.007ac9.net/)
semrushbot
mozilla/5.0 (compatible; semrushbot/1.2~bl; +http://www.semrush.com/bot.html)
netestate ne crawler
netestate ne crawler (+http://www.website-datenbank.de/)
mj12bot
mozilla/5.0 (compatible; mj12bot/v1.4.7; http://mj12bot.com/)
mozilla/5.0 (compatible; mj12bot/v1.4.8; http://mj12bot.com/)
ezooms
mozilla/5.0 (compatible; dotbot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)
bubing
bubing (+http://law.di.unimi.it/bubing.html)
bubing (+http://law.di.unimi.it/bubing.html
bubing (+http://law.di.unimi.it/bubing.html
mozilla/5.0 (compatible; alphabot/3.2; +http://alphaseobot.com/bot.html)
ltx71 - (http://ltx71.com/)
whr
megaindex
megaindex.ru/2.0
megaindex.ru/
mozilla/5.0 (compatible; megaindex.ru/2.0; +http://megaindex.com/crawler)
seokicks-robot
mozilla/5.0 (compatible; seokicks-robot; +http://www.seokicks.de/robot.html)
seznambot
mozilla/5.0 (compatible; seznambot/3.2; +http://napoveda.seznam.cz/en/seznambot-intro/)
proximic
mozilla/5.0 (compatible; proximic; +http://www.proximic.com/info/spider.php)
mozilla/5.0 (compatible; proximic; +https://www.comscore.com/web-crawler)
dotbot/1.1
mozilla/5.0 (compatible; dotbot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)
qwantify/2.4w
mozilla/5.0 (compatible; qwantify/2.4w; +https://www.qwant.com/)/2.4w)
Product | Comment |
---|---|
bubing (+http://law.di.unimi.it/bubing.html | wc) |
bubing (+http://law.di.unimi.it/bubing.html | dc) |
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /administrator/ |
Disallow | /bin/ |
Disallow | /cache/ |
Disallow | /cli/ |
Disallow | /components/ |
Disallow | /includes/ |
Disallow | /installation/ |
Disallow | /language/ |
Disallow | /layouts/ |
Disallow | /libraries/ |
Disallow | /logs/ |
Disallow | /modules/ |
Disallow | /plugins/ |
Disallow | /tmp/ |
Warnings
- 1 invalid line.
Comments