illan-gifts.ru
robots.txt

Robots Exclusion Standard data for illan-gifts.ru

Resource Scan

Scan Details

Site Domain illan-gifts.ru
Base Domain illan-gifts.ru
Scan Status Ok
Last Scan2024-09-01T07:57:28+00:00
Next Scan 2024-10-01T07:57:28+00:00

Last Scan

Scanned2024-09-01T07:57:28+00:00
URL https://illan-gifts.ru/robots.txt
Domain IPs 91.142.87.104
Response IP 91.142.87.104
Found Yes
Hash 5ff54776f0bb46b07a2ab6a02fe221b38a47063eddd4ea43ee595c23ad4cc749
SimHash 664d9672ffb3

Groups

yandex

Rule Path
Disallow *php
Disallow /*?*
Allow */?menu*
Allow /*page*
Allow /*utm_*
Disallow /*?*search*
Disallow /*?*price*
Disallow /*?*quantity*
Disallow /*?*isRecommended*
Disallow /*?*color*
Disallow /*?*size*
Disallow /*?*clothDensity*
Disallow /*?*material*
Disallow /*?*storageSize*
Disallow /*?*batteryVolume*
Disallow /*?*stockName*
Disallow /*?*coating*
Disallow /*?*brand*
Disallow /*?*features*
Disallow /*?*gender*
Disallow /restorePassword/
Disallow /favorites/
Disallow /cart/
Disallow /recent/
Disallow /corporate/
Disallow /offers/
Disallow */?page=*sort=
Disallow */novelties/?page=*
Disallow */all/?page=*
Disallow */hits/?page=*
Disallow */catalog/nabory/*
Disallow /*?page=*&
Disallow /*%26page%3D
Disallow *.pdf
Allow /*png
Allow /*jpeg

googlebot

Rule Path
Disallow *php
Disallow */?*
Disallow /restorePassword/
Disallow *search*
Disallow /cart/
Disallow /recent/
Disallow /corporate/
Disallow /offers/
Disallow /*%26*
Disallow /favorites/
Disallow */?page=*sort=
Disallow */novelties/?page=*
Disallow */all/?page=*
Disallow */hits/?page=*
Disallow /*?page=*&
Disallow /*%26page%3D
Disallow */catalog/nabory/*
Disallow *.pdf
Allow */?menu*
Allow */?page=
Allow /*utm_*
Allow /*png
Allow /*jpeg

*

Rule Path
Disallow *php
Disallow /*?*
Allow /*page*
Disallow /*?*search*
Disallow /*?*price*
Disallow /*?*quantity*
Disallow /*?*isRecommended*
Disallow /*?*color*
Disallow /*?*size*
Disallow /*?*clothDensity*
Disallow /*?*material*
Disallow /*?*storageSize*
Disallow /*?*batteryVolume*
Disallow /*?*stockName*
Disallow /*?*coating*
Disallow /*?*brand*
Disallow /*?*features*
Disallow /*?*gender*
Disallow /restorePassword/
Disallow /favorites/
Disallow /cart/
Disallow /recent/
Disallow /corporate/
Disallow /offers/
Disallow */?page=*sort=
Disallow */novelties/?page=*
Disallow */all/?page=*
Disallow */hits/?page=*
Disallow /*?page=*&
Disallow /*%26page%3D
Disallow */catalog/nabory/*
Disallow *.pdf
Allow */?menu*
Allow /*utm_*
Allow /*png
Allow /*jpeg

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

keys.so

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yak/1.0

Rule Path
Disallow /

niraiya.com/2.0

Rule Path
Disallow /

cloudfind

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

seopultcontentanalyzer/1.0

Rule Path
Disallow /

serpstatbot/2.0

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

dataforseobot/1.0

Rule Path
Disallow /

rome client (http://tinyurl.com/64t5n)

Rule Path
Disallow /

proximic bot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

serendeputy

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

weborama

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

builtwith

Rule Path
Disallow /

riddler

Rule Path
Disallow /

alittle client

Rule Path
Disallow /

linux mozilla

Rule Path
Disallow /

academicbotrtu

Rule Path
Disallow /

turnitin

Rule Path
Disallow /

Other Records

Field Value
sitemap https://illan-gifts.ru/sitemap.xml

Warnings

  • 4 invalid lines.
  • `clean-param` is not a known field.
  • `host` is not a known field.