belnovosti.by
robots.txt

Robots Exclusion Standard data for belnovosti.by

Resource Scan

Scan Details

Site Domain belnovosti.by
Base Domain belnovosti.by
Scan Status Ok
Last Scan2024-09-20T04:57:33+00:00
Next Scan 2024-09-27T04:57:33+00:00

Last Scan

Scanned2024-09-20T04:57:33+00:00
URL https://belnovosti.by/robots.txt
Redirect https://www.belnovosti.by/robots.txt
Redirect Domain www.belnovosti.by
Redirect Base belnovosti.by
Domain IPs 93.84.112.130
Redirect IPs 93.84.112.130
Response IP 93.84.112.130
Found Yes
Hash b97039a57de60b244f4775550aeaed5c3c7daa09c8a8eb284f470a7e9c79e1a8
SimHash 5894170a9f70

Groups

googlebot

Rule Path
Disallow /yandex-dzen.xml

yandex

Rule Path
Disallow /amp/

googlebot-image

Rule Path
Allow *

*

Rule Path
Allow /
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /INSTALL.sqlite.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow /admin/
Disallow /comment/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /node/add/
Disallow /search/
Disallow /user
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/logout/
Disallow /c/c
Disallow /c/b
Disallow /?q=admin%2F
Disallow /?q=comment%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=filter%2Ftips%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /?q=user%2Flogout%2F
Disallow /?q=node%2F
Disallow /hometest

Other Records

Field Value
sitemap https://www.belnovosti.by/sitemap.xml
sitemap https://www.belnovosti.by/sitemap-fast.xml
sitemap https://www.belnovosti.by/googlenews.xml
sitemap https://www.belnovosti.by/sitemap_a.txt
sitemap https://www.belnovosti.by/sitemap_b.txt
sitemap https://www.belnovosti.by/sitemap_c.txt
sitemap https://www.belnovosti.by/sitemap_d.txt
sitemap https://www.belnovosti.by/sitemap_e.txt
sitemap https://www.belnovosti.by/sitemap_f.txt
sitemap https://www.belnovosti.by/sitemap_g.txt
sitemap https://www.belnovosti.by/sitemap_h.txt
sitemap https://www.belnovosti.by/sitemap_i.txt
sitemap https://www.belnovosti.by/sitemap_j.txt
sitemap https://www.belnovosti.by/sitemap_k.txt
sitemap https://www.belnovosti.by/sitemap_l.txt
sitemap https://www.belnovosti.by/sitemap_m.txt
sitemap https://www.belnovosti.by/sitemap_n.txt
sitemap https://www.belnovosti.by/sitemap-fast.txt

Comments

  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)