kandagar.com
robots.txt

Robots Exclusion Standard data for kandagar.com

Resource Scan

Scan Details

Site Domain kandagar.com
Base Domain kandagar.com
Scan Status Ok
Last Scan2024-11-13T21:51:05+00:00
Next Scan 2024-12-13T21:51:05+00:00

Last Scan

Scanned2024-11-13T21:51:05+00:00
URL https://kandagar.com/robots.txt
Redirect https://www.kandagar.com/robots.txt
Redirect Domain www.kandagar.com
Redirect Base kandagar.com
Domain IPs 79.174.15.3
Redirect IPs 79.174.15.3
Response IP 79.174.15.3
Found Yes
Hash 55c5f17f88d0b030be62cdda49d5f48e0fc0b0bd3e739604e90c3a7f5aae957b
SimHash c0348002969a

Groups

*

Rule Path
Disallow /404.html
Disallow /kandagarnew/admin/
Disallow /kandagar/admin_stuff/
Disallow /book/do_order_send/
Disallow /user/*
Disallow /500.html
Disallow /objectsprint.php?obj=
Disallow /objectsmap
Disallow /objectsspo
Disallow /tur/viewspo
Disallow /objectskorp
Disallow /objectsny
Disallow /export
Disallow /toursearch/
Disallow /searchoffer/
Disallow /tur/offers/
Disallow /tur/book/
Disallow /book/
Disallow /payment/
Disallow /priceobject/
Disallow /bookoffer/
Disallow /printp/
Disallow /nashi-sotrudniki/
Disallow /*is_individual%3D
Disallow /infopage/glavnaya-stranica-chast-dva/
Disallow /area/*
Disallow /main

Other Records

Field Value
crawl-delay 5

mj12bot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

teoma

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

nutch

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

psbot

Rule Path
Disallow /

asterias

Rule Path
Disallow /

yahoo-blogs/v3.9

Rule Path
Disallow /

twengabot-2.0

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flexum

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

researchscan

Rule Path
Disallow /

yak

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

php

Rule Path
Disallow /

googlebot

Rule Path
Disallow /country/ukraina/

Other Records

Field Value
sitemap https://www.kandagar.com/sitemap.xml