maxibit.ru
robots.txt

Robots Exclusion Standard data for maxibit.ru

Resource Scan

Scan Details

Site Domain maxibit.ru
Base Domain maxibit.ru
Scan Status Ok
Last Scan2025-12-29T16:48:39+00:00
Next Scan 2026-01-28T16:48:39+00:00

Last Scan

Scanned2025-12-29T16:48:39+00:00
URL https://maxibit.ru/robots.txt
Domain IPs 77.222.57.100
Response IP 77.222.57.100
Found Yes
Hash 19071fb00c59351e08905b0714a726ab46521adc3c6bdb0469c9d87e87aae29b
SimHash 6e181c464ab2

Groups

googlebot

Rule Path
Disallow /?
Disallow /admin
Disallow /index.php
Disallow /emarket/addToCompare
Disallow /emarket/basket
Disallow /go_out.php
Disallow /search
Disallow /forum/
Disallow /news*

yandex

Rule Path
Disallow /?
Disallow /admin
Disallow /index.php
Disallow /emarket/addToCompare
Disallow /emarket/basket
Disallow /go_out.php
Disallow /search
Disallow /news*
Disallow /forum/

Other Records

Field Value
crawl-delay 3

*

Rule Path
Disallow /?
Disallow /admin
Disallow /index.php
Disallow /emarket/addToCompare
Disallow /emarket/basket
Disallow /go_out.php
Disallow /search
Disallow /news*
Disallow /forum/

Other Records

Field Value
sitemap http://maxibit.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.