220city.ru
robots.txt

Robots Exclusion Standard data for 220city.ru

Resource Scan

Scan Details

Site Domain 220city.ru
Base Domain 220city.ru
Scan Status Ok
Last Scan2024-04-27T08:54:14+00:00
Next Scan 2024-05-27T08:54:14+00:00

Last Scan

Scanned2024-04-27T08:54:14+00:00
URL https://220city.ru/robots.txt
Domain IPs 185.200.240.154
Response IP 185.200.240.154
Found Yes
Hash af04298b7ee6ac8d3f93b77f856db213db343062a44b0a48e83dc3e624ed5ae4
SimHash c6db5d6da22f

Groups

yandex

Rule Path
Disallow /min
Disallow /min
Disallow /max
Disallow /cost
Disallow /down
Disallow /order
Disallow /up
Disallow /onpage
Disallow /page
Disallow /registration
Disallow /cart
Disallow /cabinet
Disallow /brand-test
Disallow *mobile%3Dno*
Disallow /search*
Disallow /order_complete
Disallow /complete*
Disallow /brendy/*?*
Disallow /brendy/?*
Disallow /brendy/*/frame*
Disallow /order_complete?order=*
Disallow /catalog/part*
Disallow /catalog/*?*
Disallow /sitemap-amp1.xml
Disallow /sitemap-amp2.xml
Disallow /sitemap-amp3.xml
Disallow *?prop*
Disallow *?minprice*
Disallow *?sort*
Disallow *?cpp*
Disallow *?cm_id*
Disallow *?*
Disallow /brendy/*/*/frame/*
Disallow /brendy/*/*/frame/*/switch/*
Disallow /brendy/*/*/switch/*
Disallow /brendy/*/*/switch/*/frame/*
Disallow /catalog/*?*
Disallow /catalog/*/*?*
Disallow /404
Disallow /catalog/*/*/*/*?*
Disallow /brendy/*/catalog/*?*
Disallow /brendy/*/catalog/*/*
Disallow /brendy/*/catalog/*/*/*
Disallow /brendy/*/catalog/*/*/*/*
Disallow /catalog/*/*/*?*
Disallow /brendy/*/catalog
Disallow /brendy/*/catalog/*
Disallow /blog?page=*
Disallow /brendy/*/catalog/*/*/*/*/*
Disallow /search*
Allow *?v=*
Allow /files/imagecache
Allow /upload
Allow /upload/Main_images/*
Allow /upload/Main_images/b36f8397-507a-11e9-9507-005056bdd193.JPG

googlebot

Rule Path
Disallow /min
Disallow /max
Disallow /cost
Disallow /down
Disallow /up
Disallow /onpage
Disallow /page
Disallow /order
Disallow /registration
Disallow /cart
Disallow /cabinet
Disallow /brand-test
Disallow /complete*
Disallow *mobile%3Dno*
Disallow /brendy/*/frame*
Disallow /brendy/*?*
Disallow /brendy/?*
Disallow /search*
Disallow /catalog/part*
Disallow /catalog/*?*
Disallow /order_complete
Disallow /order_complete?order=*
Disallow *?prop*
Disallow *?minprice*
Disallow *?sort*
Disallow *?cpp*
Disallow *?cm_id*
Disallow *?*
Disallow /brendy/*/*/frame/*
Disallow /brendy/*/*/frame/*/switch/*
Disallow /brendy/*/*/switch/*
Disallow /brendy/*/*/switch/*/frame/*
Disallow /catalog/*?*
Disallow /catalog/*/*?*
Disallow /404
Disallow /catalog/*/*/*/*?*
Disallow /brendy/*/catalog/*?*
Disallow /brendy/*/catalog/*/*
Disallow /brendy/*/catalog/*/*/*
Disallow /brendy/*/catalog/*/*/*/*
Disallow /catalog/*/*/*?*
Disallow /brendy/*/catalog
Disallow /brendy/*/catalog/*
Disallow /blog?page=*
Disallow /brendy/*/catalog/*/*/*/*/*
Disallow /search*
Allow *?v=*
Allow /upload
Allow /files/imagecache
Allow /upload/Main_images/*
Allow /upload/Main_images/b36f8397-507a-11e9-9507-005056bdd193.JPG

googlebot-image

Rule Path
Allow /

dataforseobot/1.0

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

detectify

Rule Path
Disallow /

riddler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

disco pump

Rule Path
Disallow /

wget

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

psbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

netinfobot

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

w3c_validator

Rule Path
Disallow /

accoona

Rule Path
Disallow /

ask jeeves

Rule Path
Disallow /

webalta

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

tourlentabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

nigma.ru

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

statsbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

proximic

Rule Path
Disallow /

openindexspider

Rule Path
Disallow /

statdom.ru

Rule Path
Disallow /

exabot

Rule Path
Disallow /

spider

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

obot

Rule Path
Disallow /

c-t bot

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

snoopy

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

domainvader

Rule Path
Disallow /

yeti

Rule Path
Disallow /

dcpbot

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

megaindex.ru/2.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

*

Rule Path
Disallow /min
Disallow /max
Disallow /cost
Disallow /down
Disallow /order
Disallow /up
Disallow /onpage
Disallow /page
Disallow /registration
Disallow /cart
Disallow /cabinet
Disallow /brand-test
Disallow *mobile%3Dno*
Disallow /brendy/*/frame*
Disallow /brendy/*?*
Disallow /brendy/?*
Disallow /search
Disallow /order_complete
Disallow /complete*
Disallow /order_complete?order=*
Disallow /catalog/part*
Disallow /catalog/*?*
Disallow /sitemap-amp1.xml
Disallow /sitemap-amp2.xml
Disallow /sitemap-amp3.xml
Disallow /brendy/Donolux*
Disallow /brendy/Donel*
Disallow *?prop*
Disallow *?minprice*
Disallow *?sort*
Disallow *?cpp*
Disallow *?cm_id*
Disallow *?*
Allow *?v=*
Allow /upload
Allow /files/imagecache
Allow /upload/Main_images/*
Allow /upload/Main_images/b36f8397-507a-11e9-9507-005056bdd193.JPG
Disallow /brendy/*/*/frame/*
Disallow /brendy/*/*/frame/*/switch/*
Disallow /brendy/*/*/switch/*
Disallow /brendy/*/*/switch/*/frame/*
Disallow /catalog/*?*
Disallow /catalog/*/*?*
Disallow /404
Disallow /catalog/*/*/*/*?*
Disallow /brendy/*/catalog/*?*
Disallow /brendy/*/catalog/*/*
Disallow /brendy/*/catalog/*/*/*
Disallow /brendy/*/catalog/*/*/*/*
Disallow /catalog/*/*/*?*
Disallow /brendy/*/catalog
Disallow /brendy/*/catalog/*
Disallow /blog?page=*
Disallow /brendy/*/catalog/*/*/*/*/*
Disallow /search*
Disallow /search?sort=*
Disallow /files/m_config/*
Disallow /files/m_config/*
Disallow /files/m_config/*
Disallow /files/m_config/*
Disallow /files/m_config/*
Disallow /files/m_config/*
Disallow /files/m_config/*
Disallow /files/m_config/*

Other Records

Field Value
sitemap https://220city.ru/sitemap.xml
sitemap https://220city.ru/220city.ru_sitemap_base.xml
sitemap https://220city.ru/220city.ru_sitemap_add_0.xml
sitemap https://220city.ru/220city.ru_sitemap_add_1.xml
sitemap https://220city.ru/220city.ru_sitemap_add_2.xml
sitemap https://220city.ru/220city.ru_sitemap_add_3.xml
sitemap https://220city.ru/220city.ru_sitemap_add_4.xml
sitemap https://220city.ru/220city.ru_sitemap_add_5.xml
sitemap https://220city.ru/220city.ru_sitemap_add_6.xml
sitemap https://220city.ru/220city.ru_sitemap_add_7.xml
sitemap https://220city.ru/220city.ru_sitemap_add_8.xml
sitemap https://220city.ru/220city.ru_sitemap_add_9.xml
sitemap https://220city.ru/220city.ru_sitemap_add_10.xml
sitemap https://220city.ru/220city.ru_sitemap_add_11.xml
sitemap https://220city.ru/220city.ru_sitemap_add_12.xml
sitemap https://220city.ru/220city.ru_sitemap_add_13.xml
sitemap https://220city.ru/220city.ru_sitemap_add_14.xml
sitemap https://220city.ru/220city.ru_sitemap_add_15.xml
sitemap https://220city.ru/220city.ru_sitemap_add_16.xml
sitemap https://220city.ru/220city.ru_sitemap_add_17.xml
sitemap https://220city.ru/220city.ru_sitemap_add_18.xml
sitemap https://220city.ru/220city.ru_sitemap_add_19.xml
sitemap https://220city.ru/220city.ru_sitemap_add_20.xml
sitemap https://220city.ru/220city.ru_sitemap_add_21.xml

Warnings

  • `host` is not a known field.