alena-oil.ru
robots.txt

Robots Exclusion Standard data for alena-oil.ru

Resource Scan

Scan Details

Site Domain alena-oil.ru
Base Domain alena-oil.ru
Scan Status Ok
Last Scan2024-05-29T01:30:44+00:00
Next Scan 2024-06-28T01:30:44+00:00

Last Scan

Scanned2024-05-29T01:30:44+00:00
URL https://alena-oil.ru/robots.txt
Domain IPs 2a00:15f8:a000:5:1:11:3:6413, 2a00:15f8:a000:5:1:12:3:6413, 2a00:15f8:a000:5:1:13:3:6413, 2a00:15f8:a000:5:1:14:3:6413, 90.156.201.110, 90.156.201.118, 90.156.201.41, 90.156.201.64
Response IP 90.156.201.41
Found Yes
Hash dde6f041a2e6fcccaf348bc0f37db8b924b859bbef12442d729335c91a71aa9c
SimHash ed018841c490

Groups

*

Rule Path
Disallow /checkout/*
Disallow /*?_openstat=
Disallow /*?gclid=
Disallow /*?utm_source=
Disallow /*from%3Dadwords
Disallow /admin
Disallow /catalog
Disallow /download
Disallow /system
Disallow /*sort
Disallow /*order
Disallow /*%26filter%3D
Disallow /*?filter=
Disallow /politika
Disallow /?p=*
Disallow /index.php?*
Disallow /sitemap/?*
Disallow /*/?limit=*
Disallow /parser
Disallow /tmp
Disallow /?partid=1&prntid=&type=item

yandex

Rule Path
Disallow /checkout/*
Disallow /*?_openstat=
Disallow /*?gclid=
Disallow /*?utm_source=
Disallow /*from%3Dadwords
Disallow /admin
Disallow /catalog
Disallow /download
Disallow /system
Disallow /*sort
Disallow /*order
Disallow /*%26filter%3D
Disallow /*?filter=
Disallow /politika
Disallow /?p=*
Disallow /index.php?*
Disallow /sitemap/?*
Disallow /*/?limit=*
Disallow /parser
Disallow /tmp
Disallow /?partid=1&prntid=&type=item
Disallow /*search*
Allow /index.php?route=extension%2Ffeed%2Fyandex_market

googlebot

Rule Path
Allow /*.css
Allow /*.js
Allow /*.jpg
Allow /*.png
Allow /*.gif
Disallow /checkout/*
Disallow /*?_openstat=
Disallow /*?gclid=
Disallow /*?utm_source=
Disallow /*from%3Dadwords
Disallow /admin
Disallow /catalog
Disallow /download
Disallow /system
Disallow /*sort
Disallow /*order
Disallow /*%26filter%3D
Disallow /*?filter=
Disallow /politika
Disallow /?p=*
Disallow /index.php?*
Disallow /sitemap/?*
Disallow /*/?limit=*
Disallow /parser
Disallow /tmp
Disallow /?partid=1&prntid=&type=item

Other Records

Field Value
sitemap https://www.alena-oil.ru/index.php?route=extension/feed/yandex_sitemap
sitemap https://www.alena-oil.ru/index.php?route=extension/feed/google_sitemap

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.