en.vestikavkaza.ru
robots.txt

Robots Exclusion Standard data for en.vestikavkaza.ru

Resource Scan

Scan Details

Site Domain en.vestikavkaza.ru
Base Domain vestikavkaza.ru
Scan Status Ok
Last Scan2024-06-01T19:03:37+00:00
Next Scan 2024-07-01T19:03:37+00:00

Last Scan

Scanned2024-06-01T19:03:37+00:00
URL https://en.vestikavkaza.ru/robots.txt
Domain IPs 92.42.15.79
Response IP 92.42.15.79
Found Yes
Hash 3355e538c3f3918d3dd97098f0022bdd12b2b5249d35a58a2110190dfcff8c0f
SimHash 2709a884eff3

Groups

yandex

Rule Path
Disallow /search
Disallow *?
Disallow /amp*
Disallow /index.php?
Disallow /index.html
Disallow /index2.php
Disallow /index.php
Disallow /index.htm
Disallow /403/
Disallow /404/
Disallow /500/

googlebot

Rule Path
Disallow /search
Disallow *?
Disallow /index.php?
Disallow /index.html
Disallow /index2.php
Disallow /index.php
Disallow /index.htm
Disallow /403/
Disallow /404/
Disallow /500/

bingbot

Rule Path
Disallow /search
Disallow *?
Disallow /index.php?
Disallow /index.html
Disallow /index2.php
Disallow /index.php
Disallow /index.htm
Disallow /403/
Disallow /404/
Disallow /500/

*

Rule Path
Disallow /search
Disallow *?
Disallow /index.php?
Disallow /index.html
Disallow /index2.php
Disallow /index.php
Disallow /index.htm
Disallow /403/
Disallow /404/
Disallow /500/

Warnings

  • `host` is not a known field.