turiec.turistickenoviny.sk
robots.txt
Robots Exclusion Standard data for turiec.turistickenoviny.sk
Resource Scan
Scan Details
| Site Domain | turiec.turistickenoviny.sk |
| Base Domain | turistickenoviny.sk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-09-07T12:10:34+00:00 |
| Next Scan | 2024-12-06T12:10:34+00:00 |
Last Successful Scan
| Scanned | 2024-01-19T09:47:47+00:00 |
| URL | https://turiec.turistickenoviny.sk/robots.txt |
| Redirect | https://www.turiec.turistickenoviny.sk/robots.txt |
| Redirect Domain | www.turiec.turistickenoviny.sk |
| Redirect Base | turistickenoviny.sk |
| Domain IPs | 87.197.112.64 |
| Redirect IPs | 87.197.112.64 |
| Response IP | 87.197.112.64 |
| Found | Yes |
| Hash | 0d83937c1e00dd438ea8dbd0b6e96eca2b0faa6c74f1b943f655710cbb91aecc |
| SimHash | 996cc4626031 |
Groups
ahrefsbot
mozilla/5.0 (compatible; ahrefsbot/5.2; +http://ahrefs.com/robot/)
barkrowler
barkrowler/0.7 (+http://www.exensa.com/crawl)
mozilla/5.0 (compatible; 007ac9 crawler; http://crawler.007ac9.net/)
semrushbot
mozilla/5.0 (compatible; semrushbot/1.2~bl; +http://www.semrush.com/bot.html)
netestate ne crawler
netestate ne crawler (+http://www.website-datenbank.de/)
mj12bot
mozilla/5.0 (compatible; mj12bot/v1.4.7; http://mj12bot.com/)
mozilla/5.0 (compatible; mj12bot/v1.4.8; http://mj12bot.com/)
ezooms
mozilla/5.0 (compatible; dotbot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)
bubing
bubing (+http://law.di.unimi.it/bubing.html)
bubing (+http://law.di.unimi.it/bubing.html
bubing (+http://law.di.unimi.it/bubing.html
mozilla/5.0 (compatible; alphabot/3.2; +http://alphaseobot.com/bot.html)
ltx71 - (http://ltx71.com/)
whr
megaindex
megaindex.ru/2.0
megaindex.ru/
mozilla/5.0 (compatible; megaindex.ru/2.0; +http://megaindex.com/crawler)
seokicks-robot
mozilla/5.0 (compatible; seokicks-robot; +http://www.seokicks.de/robot.html)
seznambot
mozilla/5.0 (compatible; seznambot/3.2; +http://napoveda.seznam.cz/en/seznambot-intro/)
proximic
mozilla/5.0 (compatible; proximic; +http://www.proximic.com/info/spider.php)
mozilla/5.0 (compatible; proximic; +https://www.comscore.com/web-crawler)
dotbot/1.1
mozilla/5.0 (compatible; dotbot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)
qwantify/2.4w
mozilla/5.0 (compatible; qwantify/2.4w; +https://www.qwant.com/)/2.4w)
| Product | Comment |
|---|---|
| bubing (+http://law.di.unimi.it/bubing.html | wc) |
| bubing (+http://law.di.unimi.it/bubing.html | dc) |
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /bin/ |
| Disallow | /cache/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /layouts/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /tmp/ |
Warnings
- 1 invalid line.
Comments