vkrugudrusey.ru
robots.txt
Robots Exclusion Standard data for vkrugudrusey.ru
Resource Scan
Scan Details
Site Domain | vkrugudrusey.ru |
Base Domain | vkrugudrusey.ru |
Scan Status | Ok |
Last Scan | 2024-11-01T04:08:29+00:00 |
Next Scan | 2024-11-15T04:08:29+00:00 |
Last Scan
Scanned | 2024-11-01T04:08:29+00:00 |
URL | https://vkrugudrusey.ru/robots.txt |
Domain IPs | 31.184.227.51 |
Response IP | 31.184.227.51 |
Found | Yes |
Hash | 2208147c844bb4b7457d73b3f41dec580545bfc0bada58f9dea046899c818bef |
SimHash | 40160c62e533 |
Groups
yandex
Rule | Path |
---|---|
Disallow | */checkauth* |
Disallow | */edit* |
Disallow | */settings/ |
Disallow | */profile/ |
Disallow | */bill/ |
Disallow | */admin/ |
Disallow | */auth* |
Disallow | */stupidlink* |
Disallow | */go/ |
Disallow | */go?* |
Disallow | */oauthfb |
Disallow | */user/ |
Disallow | */pages/create |
Disallow | */date/ |
Disallow | */users/ |
Disallow | */members/ |
Disallow | */search/ |
Disallow | */placead |
Disallow | */projectpricing |
Disallow | */datingad |
Disallow | */adshow |
Disallow | */number-* |
Disallow | */*?*lng=* |
Disallow | *?*lng=* |
Disallow | */amp* |
Disallow | */ar/* |
Disallow | */af/* |
Disallow | */da/* |
Disallow | */de/* |
Disallow | */et/* |
Disallow | */es/* |
Disallow | */fa/* |
Disallow | */fi/* |
Disallow | */fr/* |
Disallow | */he/* |
Disallow | */hi/* |
Disallow | */hr/* |
Disallow | */hu/* |
Disallow | */hy/* |
Disallow | */id/* |
Disallow | */it/* |
Disallow | */lv/* |
Disallow | */lt/* |
Disallow | */ja/* |
Disallow | */ko/* |
Disallow | */nl/* |
Disallow | */no/* |
Disallow | */pl/* |
Disallow | */pt/* |
Disallow | */ro/* |
Disallow | */th/* |
Disallow | */tr/* |
Disallow | */uk/* |
Disallow | */vi/* |
Disallow | */zh/* |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
googlebot
Rule | Path |
---|---|
Disallow | */checkauth* |
Disallow | */edit* |
Disallow | */settings/ |
Disallow | */profile/ |
Disallow | */bill/ |
Disallow | */admin/ |
Disallow | */auth* |
Disallow | */stupidlink* |
Disallow | */go/ |
Disallow | */go?* |
Disallow | */oauthfb |
Disallow | */user/ |
Disallow | */pages/create |
Disallow | */date/ |
Disallow | */users/ |
Disallow | */members/ |
Disallow | */search/ |
Disallow | */placead |
Disallow | */projectpricing |
Disallow | */datingad |
Disallow | */adshow |
Disallow | */number-* |
Disallow | */*?*lng=* |
Disallow | *?*lng=* |
Allow | */amp*?*lng=* |
Allow | */amp?*lng=* |
Disallow | */*?*utm_source= |
Disallow | */*?*utm_medium= |
Disallow | */*?*utm_term= |
Disallow | */*?*utm_campaign= |
Disallow | *?*utm_source= |
Disallow | *?*utm_medium= |
Disallow | *?*utm_term= |
Disallow | *?*utm_campaign= |
Disallow | */?action=* |
Disallow | */*?*donotpromote* |
Disallow | */*?*unloggedid* |
Disallow | */*?*hello-answer* |
Disallow | */*%26time%3D* |
Disallow | */*?it=* |
Disallow | *?membersof* |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
slurp
Rule | Path |
---|---|
Disallow | */checkauth* |
Disallow | */edit* |
Disallow | */settings/ |
Disallow | */profile/ |
Disallow | */bill/ |
Disallow | */admin/ |
Disallow | */auth* |
Disallow | */stupidlink* |
Disallow | */go/ |
Disallow | */go?* |
Disallow | */oauthfb |
Disallow | */user/ |
Disallow | */pages/create |
Disallow | */date/ |
Disallow | */users/ |
Disallow | */members/ |
Disallow | */search/ |
Disallow | */placead |
Disallow | */projectpricing |
Disallow | */datingad |
Disallow | */adshow |
Disallow | */number-* |
Disallow | */*?*lng=* |
Disallow | *?*lng=* |
Other Records
Field | Value |
---|---|
crawl-delay | 8 |
*
Rule | Path |
---|---|
Disallow | */checkauth* |
Disallow | */edit* |
Disallow | */settings/ |
Disallow | */profile/ |
Disallow | */bill/ |
Disallow | */admin/ |
Disallow | */auth* |
Disallow | */stupidlink* |
Disallow | */go/ |
Disallow | */go?* |
Disallow | */oauthfb |
Disallow | */user/ |
Disallow | */pages/create |
Disallow | */date/ |
Disallow | */users/ |
Disallow | */members/ |
Disallow | */search/ |
Disallow | */placead |
Disallow | */projectpricing |
Disallow | */datingad |
Disallow | */adshow |
Disallow | */number-* |
Disallow | */*?*lng=* |
Disallow | *?*lng=* |
Disallow | */*?*utm_ |
Disallow | *?*utm_ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://vkrugudrusey.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.