vkrugudrusey.ru
robots.txt

Robots Exclusion Standard data for vkrugudrusey.ru

Resource Scan

Scan Details

Site Domain vkrugudrusey.ru
Base Domain vkrugudrusey.ru
Scan Status Ok
Last Scan2024-11-01T04:08:29+00:00
Next Scan 2024-11-15T04:08:29+00:00

Last Scan

Scanned2024-11-01T04:08:29+00:00
URL https://vkrugudrusey.ru/robots.txt
Domain IPs 31.184.227.51
Response IP 31.184.227.51
Found Yes
Hash 2208147c844bb4b7457d73b3f41dec580545bfc0bada58f9dea046899c818bef
SimHash 40160c62e533

Groups

spbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

pimeyes.com crawler

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

olecrawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

vedma

Rule Path
Disallow /

riddler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

yandex

Rule Path
Disallow */checkauth*
Disallow */edit*
Disallow */settings/
Disallow */profile/
Disallow */bill/
Disallow */admin/
Disallow */auth*
Disallow */stupidlink*
Disallow */go/
Disallow */go?*
Disallow */oauthfb
Disallow */user/
Disallow */pages/create
Disallow */date/
Disallow */users/
Disallow */members/
Disallow */search/
Disallow */placead
Disallow */projectpricing
Disallow */datingad
Disallow */adshow
Disallow */number-*
Disallow */*?*lng=*
Disallow *?*lng=*
Disallow */amp*
Disallow */ar/*
Disallow */af/*
Disallow */da/*
Disallow */de/*
Disallow */et/*
Disallow */es/*
Disallow */fa/*
Disallow */fi/*
Disallow */fr/*
Disallow */he/*
Disallow */hi/*
Disallow */hr/*
Disallow */hu/*
Disallow */hy/*
Disallow */id/*
Disallow */it/*
Disallow */lv/*
Disallow */lt/*
Disallow */ja/*
Disallow */ko/*
Disallow */nl/*
Disallow */no/*
Disallow */pl/*
Disallow */pt/*
Disallow */ro/*
Disallow */th/*
Disallow */tr/*
Disallow */uk/*
Disallow */vi/*
Disallow */zh/*

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Disallow */checkauth*
Disallow */edit*
Disallow */settings/
Disallow */profile/
Disallow */bill/
Disallow */admin/
Disallow */auth*
Disallow */stupidlink*
Disallow */go/
Disallow */go?*
Disallow */oauthfb
Disallow */user/
Disallow */pages/create
Disallow */date/
Disallow */users/
Disallow */members/
Disallow */search/
Disallow */placead
Disallow */projectpricing
Disallow */datingad
Disallow */adshow
Disallow */number-*
Disallow */*?*lng=*
Disallow *?*lng=*
Allow */amp*?*lng=*
Allow */amp?*lng=*
Disallow */*?*utm_source=
Disallow */*?*utm_medium=
Disallow */*?*utm_term=
Disallow */*?*utm_campaign=
Disallow *?*utm_source=
Disallow *?*utm_medium=
Disallow *?*utm_term=
Disallow *?*utm_campaign=
Disallow */?action=*
Disallow */*?*donotpromote*
Disallow */*?*unloggedid*
Disallow */*?*hello-answer*
Disallow */*%26time%3D*
Disallow */*?it=*
Disallow *?membersof*

Other Records

Field Value
crawl-delay 1

slurp

Rule Path
Disallow */checkauth*
Disallow */edit*
Disallow */settings/
Disallow */profile/
Disallow */bill/
Disallow */admin/
Disallow */auth*
Disallow */stupidlink*
Disallow */go/
Disallow */go?*
Disallow */oauthfb
Disallow */user/
Disallow */pages/create
Disallow */date/
Disallow */users/
Disallow */members/
Disallow */search/
Disallow */placead
Disallow */projectpricing
Disallow */datingad
Disallow */adshow
Disallow */number-*
Disallow */*?*lng=*
Disallow *?*lng=*

Other Records

Field Value
crawl-delay 8

*

Rule Path
Disallow */checkauth*
Disallow */edit*
Disallow */settings/
Disallow */profile/
Disallow */bill/
Disallow */admin/
Disallow */auth*
Disallow */stupidlink*
Disallow */go/
Disallow */go?*
Disallow */oauthfb
Disallow */user/
Disallow */pages/create
Disallow */date/
Disallow */users/
Disallow */members/
Disallow */search/
Disallow */placead
Disallow */projectpricing
Disallow */datingad
Disallow */adshow
Disallow */number-*
Disallow */*?*lng=*
Disallow *?*lng=*
Disallow */*?*utm_
Disallow *?*utm_

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://vkrugudrusey.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.