Log In Sign Up

sibnet.ru
robots.txt

Robots Exclusion Standard data for sibnet.ru

Resource Scan

Scan Details

Site Domain sibnet.ru
Base Domain sibnet.ru
Scan Status Ok
Last Scan2024-04-21T15:24:38+00:00
Next Scan 2024-04-28T15:24:38+00:00

Last Scan

Scanned2024-04-21T15:24:38+00:00
URL https://sibnet.ru/robots.txt
Redirect https://www.sibnet.ru/robots.txt
Redirect Domain www.sibnet.ru
Redirect Base sibnet.ru
Domain IPs 90.189.193.210, 90.189.193.211
Redirect IPs 90.189.193.210, 90.189.193.211
Response IP 90.189.193.211
Found Yes
Hash 11f04b49b214338de0fdc2f237ad88acd073640ea6f17c3963041309f908b663
SimHash e24d88d955f0

Groups

*

Rule Path
Disallow /socialauth
Disallow /registration
Disallow /password-recovery
Disallow /rt/mailing
Disallow /last_messages.php
Disallow /220volt
Disallow /-sibyt
Disallow /price_internet.html
Disallow /print.php
Disallow /promo/codfest
Disallow /reclame/?auction
Disallow /socialauth/vk
Disallow /stream
Disallow /valenki
Disallow /video
Disallow /~contplus
Disallow /~dms
Disallow /~elvit
Disallow /~goose
Disallow /~grandtour
Disallow /~ladaavto
Disallow /~nera
Disallow /~niva
Disallow /~petra
Disallow /~rus_krg
Disallow /~school
Disallow /~semico
Disallow /~sibinfo
Disallow /~sibyt
Disallow /~zerno
Disallow /~zonov

yandex

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap https://www.sibnet.ru/sitemap.xml
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • Disallow: /
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top