sairaalatukku.com
robots.txt

Robots Exclusion Standard data for sairaalatukku.com

Resource Scan

Scan Details

Site Domain sairaalatukku.com
Base Domain sairaalatukku.com
Scan Status Ok
Last Scan2025-11-24T16:44:36+00:00
Next Scan 2025-12-24T16:44:36+00:00

Last Scan

Scanned2025-11-24T16:44:36+00:00
URL https://sairaalatukku.com/robots.txt
Redirect https://www.sairaalatukku.com/robots.txt
Redirect Domain www.sairaalatukku.com
Redirect Base sairaalatukku.com
Domain IPs 94.237.37.107
Redirect IPs 94.237.37.107
Response IP 94.237.37.107
Found Yes
Hash df4264181e1a6843a2d9ba8fe5b948280d1b7c3e62c72a0824fa8b9b6eba654c
SimHash e13b79e1c7f3

Groups

*

Rule Path
Allow /*?p=
Allow /catalog/seo_sitemap/category/
Allow /media/catalog/
Disallow /404/
Disallow /app/
Disallow /cgi-bin/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /magento/
Disallow /admin/
Disallow /media/captcha/
Disallow /media/customer/
Disallow /media/dhl/
Disallow /media/downloadable/
Disallow /media/import/
Disallow /media/pdf/
Disallow /media/sales/
Disallow /media/tmp/
Disallow /media/xmlconnect/
Disallow /pkginfo/
Disallow /report/
Disallow /scripts/
Disallow /shell/
Disallow /stats/
Disallow /var/
Disallow /firecheckout/
Disallow /index.php/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /catalog/product/gallery/
Disallow /catalogsearch/
Disallow /checkout/
Disallow /control/
Disallow /contacts/
Disallow /customer/
Disallow /customize/
Disallow /newsletter/
Disallow /poll/
Disallow /review/
Disallow /sendfriend/
Disallow /tag/
Disallow /wishlist/
Disallow /viewed/
Disallow /productpdf/
Disallow /api.php
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt
Disallow /README.txt
Disallow /RELEASE_NOTES.txt
Disallow /get.php
Disallow /*.php$
Disallow /*?SID=
Disallow /rss*
Disallow /*PHPSESSID
Disallow *isAjax%3D
Disallow *ajax%3D
Disallow *cat%3D
Disallow *dir%3D
Disallow *order%3D
Disallow *mode%3D
Disallow *limit%3D
Disallow *size%3D
Disallow *brand%3D
Disallow *color%3D
Disallow *gan_data%3D
Disallow *price%3D
Disallow *price_from%3D
Disallow *price_to%3D
Disallow *shopby%3D
Disallow *depth%3D
Disallow *height%3D
Disallow *length%3D
Disallow *width%3D
Disallow *feature_images%3D
Disallow *special_diet%3D
Disallow *width%3D
Disallow *width_no_price%3D

Other Records

Field Value
crawl-delay 25

aboundex

Rule Path
Disallow /

acunetix

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

bspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

botalot

Rule Path
Disallow /

catexplorador

Rule Path
Disallow /

doc

Rule Path
Disallow /

dispatch

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

exabot

Rule Path
Disallow /

fetch

Rule Path
Disallow /

grafula

Rule Path
Disallow /

http::lite

Rule Path
Disallow /

httrack

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

jetcar

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

npbot

Rule Path
Disallow /

nmap

Rule Path
Disallow /

nuclei

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

outfoxbot

Rule Path
Disallow /

pecl::http

Rule Path
Disallow /

phpcrawl

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

riddlerbot

Rule Path
Disallow /

sbider

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

snoopy

Rule Path
Disallow /

spankbot

Rule Path
Disallow /

szukacz

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

telesphoreo

Rule Path
Disallow /

tighttwatbot

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

vericitecrawler

Rule Path
Disallow /

virusdie

Rule Path
Disallow /

wwwoffle

Rule Path
Disallow /

web collage

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

xenu

Rule Path
Disallow /

yandex

Rule Path
Disallow /

zao

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

zend_http_client

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

check1.exe

Rule Path
Disallow /

curl

Rule Path
Disallow /

fast

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

linko

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

ripz

Rule Path
Disallow /

scan.lol

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

ubermetrics-technologies.com

Rule Path
Disallow /

urllib

Rule Path
Disallow /

wget

Rule Path
Disallow /

Comments

  • Crawlers Setup
  • Allowable Index
  • Directories
  • Paths (clean URLs)
  • Files
  • Paths (no clean URLs)
  • Layered Navigation