buransnab.ru
robots.txt

Robots Exclusion Standard data for buransnab.ru

Resource Scan

Scan Details

Site Domain buransnab.ru
Base Domain buransnab.ru
Scan Status Ok
Last Scan2024-10-28T03:31:20+00:00
Next Scan 2024-11-27T03:31:20+00:00

Last Scan

Scanned2024-10-28T03:31:20+00:00
URL https://buransnab.ru/robots.txt
Domain IPs 2a03:6f00:1::5c35:608f, 92.53.96.143
Response IP 92.53.96.143
Found Yes
Hash 18c92af9aa1334b7f82358267ad30d38f14a182b81c0dedb4fc1f10a9b8c2a2b
SimHash 262a88b2cb12

Groups

*

Rule Path
Allow /
Disallow /?
Disallow *?
Disallow /oformlenie-zakaza

Other Records

Field Value
crawl-delay 20

exabot

Rule Path
Disallow /

idbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

baidu

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://buransnab.ru/sitemap.xml

Comments

  • Clean-param: param [page]

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.