Log In Sign Up

ao.by
robots.txt

Robots Exclusion Standard data for ao.by

Resource Scan

Scan Details

Site Domain ao.by
Base Domain ao.by
Scan Status Ok
Last Scan2025-10-15T07:03:48+00:00
Next Scan 2025-10-22T07:03:48+00:00

Last Scan

Scanned2025-10-15T07:03:48+00:00
URL https://ao.by/robots.txt
Redirect https://www.ao.by/robots.txt
Redirect Domain www.ao.by
Redirect Base ao.by
Redirect IPs 95.142.38.144
Response IP 95.142.38.144
Found Yes
Hash 0e4e26e4930e840d1fa128a07b4a9123a9a6d9e25b2af3ad3f36a0ef98935805
SimHash 183c09539a2b

Groups

yandex

Rule Path
Disallow /netcat/
Allow /netcat/modules/*/images/
Disallow /install/
Disallow /login/
Disallow /private/
Disallow /remember/
Disallow /goto.php
Disallow /bburl.php
Disallow /profile/
Disallow /registration/
Disallow /search/
Disallow /subscribe/
Disallow /tags/
Disallow /uprava/
Disallow /admin/
Disallow /all/
Disallow /*/dannoe
Disallow /*/seli

googlebot-mobile

Rule Path
Disallow /

googlebot

Rule Path
Disallow /netcat/
Allow /netcat/modules/*/images/
Disallow /install/
Disallow /login/
Disallow /private/
Disallow /remember/
Disallow /goto.php
Disallow /bburl.php
Disallow /profile/
Disallow /registration/
Disallow /search/
Disallow /subscribe/
Disallow /tags/
Disallow /uprava/
Disallow /admin/
Disallow /all/
Disallow /*/dannoe
Disallow /*/seli

mediapartners-google

Rule Path
Disallow /netcat/
Allow /netcat/modules/*/images/
Disallow /install/
Disallow /login/
Disallow /private/
Disallow /remember/
Disallow /goto.php
Disallow /bburl.php
Disallow /profile/
Disallow /registration/
Disallow /search/
Disallow /subscribe/
Disallow /tags/
Disallow /uprava/
Disallow /admin/
Disallow /all/
Disallow /*/dannoe
Disallow /*/seli

*

Rule Path Comment
Disallow /profile/ 33
Disallow /registration/ 34
Disallow /search/ 61
Disallow /tags/ 62
Disallow /lenta/ 391
Disallow /netcat/ -
Allow /netcat/modules/*/images/ -
Allow /lenta/lenta.xml -
Disallow /install/ -
Disallow /login/ -
Disallow /private/ -
Disallow /remember/ -
Disallow /goto.php -
Disallow /bburl.php -
Disallow /profile/ -
Disallow /registration/ -
Disallow /search/ -
Disallow /subscribe/ -
Disallow /tags/ -
Disallow /uprava/ -
Disallow /admin/ -
Disallow /all/ -
Disallow /*/dannoe -
Disallow /*/seli -

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

megaindexbot

Rule Path
Disallow /

seo-powersuite-bot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.ao.by/sitemap.xml
sitemap https://www.ao.by/sitemap.xml
sitemap https://www.ao.by/sitemap.xml
Back to top

Comments

  • File for www.ao.by, for mobile site m.ao.by see in netcat
  • Auto-generated section. Do not change.
  • End of auto-generated section.
  • Alexa: https://support.alexa.com/hc/en-us/articles/200450194-Alexa-s-Web-and-Site-Audit-Crawlers
  • archive.org
  • Ahrefs: https://ahrefs.com/robot
  • MOZ: https://moz.com/help/moz-procedures/crawlers/rogerbot
  • MOZ: https://moz.com/help/moz-procedures/crawlers/dotbot
  • DataForSeo https://dataforseo.com/dataforseo-bot
  • Semrush: https://www.semrush.com/bot/
  • Majestic: https://mj12bot.com/
  • SerpStat: https://serpstatbot.com/
  • MegaIndex: https://ru.megaindex.com/blog/seo-bot-detection
  • SEO-PowerSuite-bot: https://www.link-assistant.com/seo-workflow/site-audit.html
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top