probiznesmen.ru
robots.txt

Robots Exclusion Standard data for probiznesmen.ru

Resource Scan

Scan Details

Site Domain probiznesmen.ru
Base Domain probiznesmen.ru
Scan Status Ok
Last Scan2024-07-02T02:17:10+00:00
Next Scan 2024-07-09T02:17:10+00:00

Last Scan

Scanned2024-07-02T02:17:10+00:00
URL https://probiznesmen.ru/robots.txt
Domain IPs 45.87.219.5
Response IP 45.87.219.5
Found Yes
Hash 54bce3e5cfe5ecaf86750ef6d21847865e1a109cb516b341d43dfac35de08f93
SimHash 6580a87384b4

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /?
Disallow /search
Disallow /author
Disallow /users
Disallow */trackback
Disallow /wp-
Disallow *?s=
Disallow *%26s%3D
Disallow */embed
Disallow /xmlrpc.php
Disallow *utm%3D
Disallow *openstat%3D
Disallow /tag/
Disallow */?tdb_action=tdb_ajax
Allow */uploads

googlebot

Rule Path
Disallow /cgi-bin
Disallow /?
Disallow /search
Disallow /author
Disallow /users
Disallow /wp-
Disallow *?s=
Disallow *%26s%3D
Disallow */trackback
Disallow */embed
Disallow /xmlrpc.php
Disallow *utm%3D
Disallow *openstat%3D
Disallow */?tdb_action=tdb_ajax
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-admin/admin-ajax.php

yandex

Rule Path
Disallow /cgi-bin
Disallow /?
Disallow /wp-
Disallow *?s=
Disallow *%26s%3D
Disallow /search
Disallow /author
Disallow /users
Disallow */trackback
Disallow */embed
Disallow /xmlrpc.php
Disallow /%28.*%29%5C/amp
Disallow /amp
Disallow /?noamp=mobile
Allow /wp-*.jpg
Allow /wp-admin/admin-ajax.php
Allow */uploads
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Disallow */?tdb_action=tdb_ajax

Other Records

Field Value
sitemap https://probiznesmen.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.