cistysvet.sk
robots.txt

Robots Exclusion Standard data for cistysvet.sk

Resource Scan

Scan Details

Site Domain cistysvet.sk
Base Domain cistysvet.sk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-04T04:25:07+00:00
Next Scan 2024-10-02T04:25:07+00:00

Last Successful Scan

Scanned2024-02-13T04:22:53+00:00
URL https://cistysvet.sk/robots.txt
Redirect https://www.cistysvet.sk/robots.txt
Redirect Domain www.cistysvet.sk
Redirect Base cistysvet.sk
Domain IPs 109.74.157.96
Redirect IPs 109.74.157.96
Response IP 109.74.157.96
Found Yes
Hash 6241856ffff7f18dc5329b09976ddff8307f48022d15d70ea4319ad3f2ae93a9
SimHash 085381746541

Groups

googlebot

Rule Path
Allow /
Disallow /?page=kosik
Disallow *%2C*
Disallow *%2C*
Disallow *%26*%26*%26

seznambot

Rule Path
Allow /
Disallow /?page=kosik
Disallow *%2C*
Disallow *%2C*
Disallow *%26*%26*%26

bingbot

Rule Path
Allow /
Disallow /?page=kosik
Disallow *%2C*
Disallow *%2C*
Disallow *%26*%26*%26

slurp

Rule Path
Allow /
Disallow /?page=kosik
Disallow *%2C*
Disallow *%2C*
Disallow *%26*%26*%26

duckduckbot

Rule Path
Allow /
Disallow /?page=kosik
Disallow *%2C*
Disallow *%2C*
Disallow *%26*%26*%26

baiduspider
yandexbot

Rule Path
Allow /
Disallow /?page=kosik
Disallow *%2C*
Disallow *%2C*
Disallow *%26*%26*%26

applebot

Rule Path
Allow /
Disallow /?page=kosik
Disallow *%2C*
Disallow *%2C*
Disallow *%26*%26*%26

ia_archiver

Rule Path
Allow /
Disallow /?page=kosik
Disallow *%2C*
Disallow *%2C*
Disallow *%26*%26*%26

msnbot

Rule Path
Allow /
Disallow /?page=kosik
Disallow *%2C*
Disallow *%2C*
Disallow *%26*%26*%26

naverbot

Rule Path
Allow /
Disallow /car_detail.php
Disallow /seznam-prodejcu*search%3D
Disallow /crash-testy*text%3D
Disallow /nahled/
Disallow /*pojisteni-direct
Disallow /?article=
Disallow /cebia-vin
Disallow /hlidaci-pes/
Disallow /mobileRedir/
Disallow /prejit-na-desktop/
Disallow /prejit-na-mobil/
Disallow /bannerova-reklama
Disallow *%2C*
Disallow *%2C*
Disallow *%26*%26*%26
Allow /inzerce/osobni?cena-od=100000&cena-do=750000&typ=kombi%2Cliftback%2Csuv%2Ccuv%2Cmpv
Disallow /inzerce/osobni?cena-od=100000&cena-do=750000&typ=kombi%2Cliftback%2Csuv%2Ccuv%2Cmpv&
Allow /inzerce/osobni?cena-od=150000&typ=suv%2Cterenni%2Cpick-up%2Ccuv&pohon=4x4
Disallow /inzerce/osobni?cena-od=150000&typ=suv%2Cterenni%2Cpick-up%2Ccuv&pohon=4x4&
Allow /inzerce/osobni?cena-od=250000&vyrobeno-od=2017&typ=kombi%2Cliftback%2Csedanlimuzina
Disallow /inzerce/osobni?cena-od=250000&vyrobeno-od=2017&typ=kombi%2Cliftback%2Csedanlimuzina&
Allow /inzerce/osobni?cena-od=150000&vyrobeno-od=2010&km-do=200000&vykon-od=200kw&typ=kombi%2Cliftback%2Chatchback%2Ckupe%2Croadster%2Csedanlimuzina%2Ckabriolet
Disallow /inzerce/osobni?cena-od=150000&vyrobeno-od=2010&km-do=200000&vykon-od=200kw&typ=kombi%2Cliftback%2Chatchback%2Ckupe%2Croadster%2Csedanlimuzina%2Ckabriolet&

mediapartners-google

Rule Path
Disallow

baiduspider

Rule Path
Disallow

yandexbot

Rule Path
Disallow

facebot

Rule Path
Disallow

facebookexternalhit

Rule Path
Disallow

twitterbot

Rule Path
Disallow

bingpreview

Rule Path
Disallow

vkshare

Rule Path
Disallow

mail.ru_bot

Rule Path
Disallow

*

Rule Path
Disallow /

Comments

  • multichoice
  • 4+ params
  • multichoice
  • 4+ params
  • multichoice
  • 4+ params
  • multichoice
  • 4+ params
  • multichoice
  • 4+ params
  • multichoice
  • 4+ params
  • multichoice
  • 4+ params
  • multichoice
  • 4+ params
  • multichoice
  • 4+ params
  • multichoice
  • 4+ params
  • Homepage categories
  • Better safe than sorry

Warnings

  • 1 invalid line.