sibdom.ru
robots.txt

Robots Exclusion Standard data for sibdom.ru

Resource Scan

Scan Details

Site Domain sibdom.ru
Base Domain sibdom.ru
Scan Status Ok
Last Scan2024-09-26T03:32:37+00:00
Next Scan 2024-10-26T03:32:37+00:00

Last Scan

Scanned2024-09-26T03:32:37+00:00
URL https://sibdom.ru/robots.txt
Redirect https://www.sibdom.ru/robots.txt
Redirect Domain www.sibdom.ru
Redirect Base sibdom.ru
Domain IPs 104.21.88.28, 172.67.171.253, 2606:4700:3030::ac43:abfd, 2606:4700:3032::6815:581c
Redirect IPs 95.172.129.149
Response IP 95.172.129.149
Found Yes
Hash 3a80f590c1431695e75b382076e245c2520e433aa456b0790374dfb447391ee7
SimHash c12b554b86b9

Groups

*

Rule Path
Disallow /docs/
Disallow /gfx/
Disallow /cabinet/
Disallow /cgi-bin/
Disallow /admin/
Disallow /error/
Disallow /mail/
Disallow /notepad/
Disallow /stickers/claim/
Disallow /stickers/mail/
Disallow /mail
Disallow /notepad
Disallow /stickers/claim
Disallow /stickers/mail
Disallow /stickers/promotionform*
Disallow /stickers/promotion*
Disallow /cabinet*
Disallow /board/*
Disallow /feedback/*
Disallow /auth/register*
Disallow /stickers/showphone*
Disallow /forum_theme.php?*
Disallow /forum_register.php
Disallow /forum_search.php
Disallow /forum/claim
Disallow /forum/theme_add/*
Disallow *reply*
Disallow /buildings.php
Disallow /build_search.php
Disallow /building_info.php
Disallow /document.php
Disallow /documents.php
Disallow /cache/*
Disallow /board/images/*
Disallow /board/stickers/*
Disallow /board/images/*
Disallow /pic/*
Disallow /sibdom/*
Disallow *ajax*
Disallow /api*
Disallow /auth/
Disallow /images/photo_crop_263_198/stickers/*
Disallow /images/photo_crop_594_446/stickers/*
Disallow /images/photo_crop_164_120/stickers/*
Disallow /photo_1600_1200/stickers/*
Disallow /banners/*
Disallow /favorites*
Disallow /jmp.php*

yandex

Rule Path
Disallow /docs/
Disallow /gfx/
Disallow /cabinet/
Disallow /cgi-bin/
Disallow /admin/
Disallow /error/
Disallow /mail/
Disallow /notepad/
Disallow /stickers/claim/
Disallow /stickers/mail/
Disallow /mail
Disallow /notepad
Disallow /stickers/claim
Disallow /stickers/mail
Disallow /stickers/promotionform*
Disallow /stickers/promotion*
Disallow /cabinet*
Disallow /board/*
Disallow /feedback/*
Disallow /auth/register*
Disallow /stickers/showphone*
Disallow /forum_theme.php?*
Disallow /forum_register.php
Disallow /forum_search.php
Disallow /forum/claim
Disallow /forum/theme_add/*
Disallow *reply*
Disallow /buildings.php
Disallow /build_search.php
Disallow /building_info.php
Disallow /document.php
Disallow /documents.php
Disallow /cache/*
Disallow /board/images/*
Disallow /board/stickers/*
Disallow /board/images/*
Disallow /pic/*
Disallow /sibdom/*
Disallow *ajax*
Disallow /api*
Disallow /auth/
Disallow /images/photo_crop_263_198/stickers/*
Disallow /images/photo_crop_594_446/stickers/*
Disallow /images/photo_crop_164_120/stickers/*
Disallow /photo_1600_1200/stickers/*
Disallow /banners/*

stackrambler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

sbider

Rule Path
Disallow /

oozbot

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

yahoo-slurp

Rule Path
Disallow /

slurp

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

yak

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.sibdom.ru/upload/sitemaps/24/sitemap_https.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.