koala.sk
robots.txt

Robots Exclusion Standard data for koala.sk

Resource Scan

Scan Details

Site Domain koala.sk
Base Domain koala.sk
Scan Status Ok
Last Scan2024-10-10T11:57:08+00:00
Next Scan 2024-11-09T11:57:08+00:00

Last Scan

Scanned2024-10-10T11:57:08+00:00
URL https://koala.sk/robots.txt
Domain IPs 171.25.220.89
Response IP 171.25.220.89
Found Yes
Hash 2b259bcd56cbed2951a27b69d55c317d17ed2a7cc77f1561eadc89be20215daa
SimHash dc0c9a30deb8

Groups

*

Rule Path
Allow /
Disallow files.koala.sk
Disallow files.koala.sk/dealer/
Disallow email.koala.sk
Disallow lastminute.koala.sk/
Disallow bannery.koala.sk/
Disallow /*?date=*
Disallow *%3Ddate%26date%3D*
Disallow *%26query%3D*
Disallow /*?destinationId=*
Disallow /*?DestinationRootID=*
Disallow *%26StateOpt%3D*
Disallow *%26transportationId%3D*
Disallow *%26transportationFromId%3D*
Disallow *%26stars%3D*
Disallow /*?DestinationID=*
Disallow *%26StationID%3D*
Disallow *%26JourneyID%3D*
Disallow *%26TermID%3D*
Disallow *%26RoomID%3D*
Disallow /*fotografie?i=*
Disallow /objednavka/
Disallow /objednavka
Disallow /editace
Disallow /partner
Disallow /proces-rezervace-dokoncen/
Disallow /e/
Disallow /o/
Disallow /tpls/

barkrowler

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

magpie-crawler/1.1

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

neticle

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

adstxtcrawlertp

Rule Path
Disallow /

Comments

  • babbar.tech/crawler
  • babbar.tech/crawler
  • brandwatch.net
  • brandwatch.net
  • opensiteexplorer.org/dotbot
  • moz.com/help/moz-procedures/crawlers/rogerbot
  • ahrefs.com
  • semrush.com
  • webmaster.petalsearch.com/site/petalbot
  • majestic.com
  • yandex.com
  • yandex.com
  • dataforseo.com/dataforseo-bot
  • help.coccoc.com/search-engine
  • mojeek.com/bot.html
  • bot.neticle.hu
  • webmeup-crawler.com
  • AdsTxtCrawlerTP