Log In Sign Up

conditionery-itm.ru
robots.txt

Robots Exclusion Standard data for conditionery-itm.ru

Resource Scan

Scan Details

Site Domain conditionery-itm.ru
Base Domain conditionery-itm.ru
Scan Status Ok
Last Scan2024-10-17T15:44:12+00:00
Next Scan 2024-11-16T15:44:12+00:00

Last Scan

Scanned2024-10-17T15:44:12+00:00
URL https://conditionery-itm.ru/robots.txt
Domain IPs 87.236.16.91
Response IP 87.236.16.91
Found Yes
Hash cb08e8a17568b7ab1b63a2e06abf6f12733b9959d7a6c85887734a2460593d98
SimHash 6d559d17c1d8

Groups

geedobot

Rule Path
Disallow /

yandex

Rule Path
Disallow /popular
Disallow /skidki-i-akcii-na-kondicionery-i-split-sistemy.html/
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /tmp/
Disallow /zakaz/
Disallow /zakaz/*
Disallow /cron.php
Disallow /update.php
Disallow /admin/
Disallow /comment/
Disallow /comment/*/
Disallow /filter/tips/
Disallow /node/
Disallow /search/
Disallow /taxonomy/term/
Disallow /user/
Disallow /user/*/
Disallow /tech/
Disallow /tech/*
Disallow /error
Disallow /component/
Disallow /spisok-metok/
Disallow /?*
Disallow /*?*
Disallow /zakazy/4271
Disallow /net.html-5
Disallow /da.html-9
Disallow /cart
Disallow /da.html-17
Disallow /da.html-2
Disallow /zakaz
Disallow /product/*
Disallow /product/
Disallow /zakazy/*
Disallow /zakazy/
Disallow /teplovye-zavesy.htmlproduct/
Disallow /teplovye-zavesy.htmlproduct/*
Disallow /teplovye-zavesy.html*
Disallow /taxonomy/term/*

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /popular
Disallow /skidki-i-akcii-na-kondicionery-i-split-sistemy.html/
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /tmp/
Disallow /zakaz/
Disallow /zakaz/*
Disallow /cron.php
Disallow /update.php
Disallow /admin/
Disallow /comment/
Disallow /comment/*/
Disallow /filter/tips/
Disallow /node/
Disallow /search/
Disallow /taxonomy/term/
Disallow /user/
Disallow /user/*/
Disallow /tech/
Disallow /tech/*
Disallow /error
Disallow /component/
Disallow /spisok-metok/
Disallow /?*
Disallow /*?*
Disallow /zakazy/4271
Disallow /net.html-5
Disallow /da.html-9
Disallow /cart
Disallow /da.html-17
Disallow /da.html-2
Disallow /zakaz
Disallow /taxonomy/term/*
Disallow /product/*
Disallow /product/
Disallow /zakazy/*
Disallow /zakazy/
Disallow /teplovye-zavesy.html*
Disallow /teplovye-zavesy.htmlproduct/
Disallow /teplovye-zavesy.htmlproduct/*

*

Rule Path
Disallow /popular
Disallow /skidki-i-akcii-na-kondicionery-i-split-sistemy.html/
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /tmp/
Disallow /zakaz/
Disallow /zakaz/*
Disallow /cron.php
Disallow /update.php
Disallow /admin/
Disallow /comment/
Disallow /comment/*/
Disallow /filter/tips/
Disallow /node/
Disallow /search/
Disallow /taxonomy/term/
Disallow /user/
Disallow /user/*/
Disallow /tech/
Disallow /tech/*
Disallow /error
Disallow /component/
Disallow /spisok-metok/
Disallow /?*
Disallow /*?*
Disallow /zakazy/4271
Disallow /net.html-5
Disallow /da.html-9
Disallow /cart
Disallow /da.html-17
Disallow /da.html-2
Disallow /zakaz
Disallow /taxonomy/term/*
Disallow /product/*
Disallow /product/
Disallow /zakazy/*
Disallow /zakazy/
Disallow /teplovye-zavesy.htmlproduct/
Disallow /teplovye-zavesy.htmlproduct/*
Disallow /teplovye-zavesy.html*

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://conditionery-itm.ru/sitemap.xml
Back to top

Comments

  • Directories
  • Files
  • Paths (clean URLs)
  • Paths tech and errors
  • Paths (no clean URLs)
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths tech and errors
  • Paths (no clean URLs)
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths tech and errors
  • Paths (no clean URLs)
Back to top

Warnings

  • `host` is not a known field.
Back to top