bogemia.by
robots.txt

Robots Exclusion Standard data for bogemia.by

Resource Scan

Scan Details

Site Domain bogemia.by
Base Domain bogemia.by
Scan Status Ok
Last Scan2025-03-12T11:24:30+00:00
Next Scan 2025-04-11T11:24:30+00:00

Last Scan

Scanned2025-03-12T11:24:30+00:00
URL https://bogemia.by/robots.txt
Domain IPs 2a0a:7d80:1:7::80:21f, 93.125.99.61
Response IP 93.125.99.61
Found Yes
Hash ce87c65dea90da10650c2fa5477dbb8650c2669f32384009caa47a3444831064
SimHash 1a041418c7d4

Groups

yandex

Rule Path
Disallow /*?id=
Disallow /kalendar-turov?field*
Disallow /includes/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /INSTALL.sqlite.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow *.doc
Disallow *.docx
Disallow /admin/
Disallow /tours/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /node/add/
Disallow /search/
Disallow /order
Disallow /order/
Disallow /user*
Disallow /newsletters/
Disallow /?q=*
Disallow /*zakazat-tur?*
Disallow /slideshow*
Disallow /123
Disallow /*menedzhery*
Disallow /sposoby-oplaty/onlayn-oplata
Disallow /arhiv
Disallow /777*
Disallow /newsletter*

googlebot

Rule Path
Disallow /*?id=
Disallow /kalendar-turov?field*
Disallow /includes/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /INSTALL.sqlite.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow *.doc
Disallow *.docx
Disallow /admin/
Disallow /tours/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /node/add/
Disallow /search/
Disallow /user*
Disallow /order
Disallow /order/
Disallow /newsletters/
Disallow /?q=*
Disallow /*zakazat-tur?*
Disallow /slideshow*
Disallow /123
Disallow /*menedzhery*
Disallow /sposoby-oplaty/onlayn-oplata
Disallow /777*
Disallow /newsletter*

*

Rule Path
Disallow /*?id=
Disallow /kalendar-turov?field*
Disallow /includes/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /INSTALL.sqlite.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow *.doc
Disallow *.docx
Disallow /admin/
Disallow /tours/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /node/add/
Disallow /search/
Disallow /user*
Disallow /order
Disallow /order/
Disallow /newsletters/
Disallow /?q=*
Disallow /*zakazat-tur?*
Disallow /slideshow*
Disallow /123
Disallow /*menedzhery*
Disallow /sposoby-oplaty/onlayn-oplata
Disallow /777*
Disallow /newsletter*

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://bogemia.by/sitemap.xml

Comments

  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Pages
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Pages
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Pages