shop220.ru
robots.txt

Robots Exclusion Standard data for shop220.ru

Resource Scan

Scan Details

Site Domain shop220.ru
Base Domain shop220.ru
Scan Status Ok
Last Scan2024-09-20T13:42:59+00:00
Next Scan 2024-10-20T13:42:59+00:00

Last Scan

Scanned2024-09-20T13:42:59+00:00
URL https://shop220.ru/robots.txt
Domain IPs 91.215.42.211
Response IP 91.215.42.211
Found Yes
Hash 747292b68d79e6a5a9021fef938d5ca255bc0c6b33f32734f24658d1ded3faa1
SimHash e12b5862ef37

Groups

*

Rule Path
Disallow /register/*
Disallow *.htm*/*
Disallow *?action=addToPersonCart*
Disallow /adverts/*
Disallow /privacy/*
Disallow /legal/*
Disallow *Brand%3D*
Disallow *brand%3D*
Disallow *search_ras%3Dyes*
Disallow /?id=1
Disallow /?id=2
Disallow /admin/
Disallow /search/?*
Disallow /search2/?*
Disallow */index.php*
Disallow *cid%3D*
Disallow *special*
Disallow /adverts/add
Disallow /cat.htm
Disallow /product.htm
Disallow /*pid%3D*
Disallow /?action=cabinet*
Disallow *?action=cabinet*
Disallow /?param*
Disallow /?action=pwdRecall*
Disallow /cart/
Disallow /?City*
Disallow *?etext*
Disallow /search-region*
Disallow /constructor/?*
Disallow /orders/
Disallow *qd%3D*
Disallow /wishlist.htm
Disallow /vacansii*
Disallow /mekhanizmy-v-sbore*

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

grapeshot

Rule Path
Disallow /

megaindex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

riddler (http://riddler.io/about)

Rule Path
Disallow /

python-urllib/2.6

Rule Path
Disallow /

disco pump

Rule Path
Disallow /

wget

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

psbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

netinfobot

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://shop220.ru/sitemap/all_sitemap_0.xml

Comments

  • Disallow: *setregion=*
  • Clean-param: setregion /*

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.