vagvin.ru
robots.txt

Robots Exclusion Standard data for vagvin.ru

Resource Scan

Scan Details

Site Domain vagvin.ru
Base Domain vagvin.ru
Scan Status Ok
Last Scan2026-03-05T02:04:13+00:00
Next Scan 2026-04-04T02:04:13+00:00

Last Scan

Scanned2026-03-05T02:04:13+00:00
URL https://vagvin.ru/robots.txt
Domain IPs 141.8.192.26, 2a0a:2b42:0:26::
Response IP 141.8.192.26
Found Yes
Hash b7442af71cc3d63d688ad7df0f765468848e729245edd6c139f180773d26691b
SimHash 6e1d9ad7a9f0

Groups

*

Rule Path
Allow /
Disallow /dashboard
Disallow /logout
Disallow /login
Disallow /register
Disallow /forgot_password
Disallow /static/logs/
Disallow /__pycache__/
Disallow /kyc
Disallow /api
Disallow /apos
Disallow /site.wsgi
Disallow /site.wsgi/

googlebot

Rule Path
Allow /

yandex

Rule Path
Allow /

bingbot

Rule Path
Allow /
Allow /rss
Allow /turbo

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://vagvin.ru/sitemap.xml

Comments

  • Основные поисковые боты
  • Карта сайта
  • RSS Feed
  • Время между запросами