Log In Sign Up

siliconrus.com
robots.txt

Robots Exclusion Standard data for siliconrus.com

Resource Scan

Scan Details

Site Domain siliconrus.com
Base Domain siliconrus.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-22T11:24:35+00:00
Next Scan 2024-12-21T11:24:35+00:00

Last Successful Scan

Scanned2023-05-26T10:13:55+00:00
URL https://siliconrus.com/robots.txt
Redirect https://vc.ru/robots.txt
Redirect Domain vc.ru
Redirect Base vc.ru
Domain IPs 185.137.235.16
Redirect IPs 104.21.43.166, 172.67.181.185, 2606:4700:3032::6815:2ba6, 2606:4700:3036::ac43:b5b9
Response IP 172.67.181.185
Found Yes
Hash 4959a90c32e79e6b9ebadb7af80003da1bee45356fcd57a21e60bb2fa71314f1
SimHash 6f218160f5b5

Groups

yandex

Rule Path
Disallow /redirect
Disallow /admin
Disallow /auth
Disallow /hit
Disallow /private
Disallow /search
Disallow /writing
Allow /static/*.css
Allow /static/*.js

*

Rule Path
Disallow /redirect
Disallow /admin
Disallow /auth
Disallow /hit
Disallow /private
Disallow /search
Disallow /writing
Disallow /s/welltory/*
Allow /static/*.css
Allow /static/*.js
Allow /.well-known/*.json

yandexdirect

Rule Path
Disallow

twitterbot

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://vc.ru/sitemap.xml
Back to top

Comments

  • .-----------------------------------.
  • ( Итю, что показать роботам, пододите )
  • ,-----------------------------------'
  • -'
  • ,
  • ,-. _,---._ __ / \
  • / ) .-' `./ / \
  • ( ( ,' `/ /|
  • \ `-" \'\ / |
  • `. , \ \ / |
  • /`. ,'-`----Y |
  • ( ; | '
  • | ,-. ,-' | /
  • | | ( | CMTT.RU | /
  • ) | \ `.___________|/
  • `--' `--'
Back to top

Warnings

  • `host` is not a known field.
Back to top