tovarkran.ru
robots.txt
Robots Exclusion Standard data for tovarkran.ru
Resource Scan
Scan Details
| Site Domain | tovarkran.ru |
| Base Domain | tovarkran.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-11-01T17:27:23+00:00 |
| Next Scan | 2024-11-08T17:27:23+00:00 |
Last Successful Scan
| Scanned | 2024-10-01T17:10:16+00:00 |
| URL | https://tovarkran.ru/robots.txt |
| Domain IPs | 2a00:15f8:a000:5:1:11:6:d075, 2a00:15f8:a000:5:1:12:6:d075, 2a00:15f8:a000:5:1:13:6:d075, 2a00:15f8:a000:5:1:14:6:d075, 90.156.201.38, 90.156.201.77, 90.156.201.79, 90.156.201.97 |
| Response IP | 90.156.201.97 |
| Found | Yes |
| Hash | d9cfeabbcc9a8097a8d099ede13950fb09e2a95b04f4aecab4d3f75b7d0f7683 |
| SimHash | 2b4950650381 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /bitrix/ |
| Disallow | *bitrix_*%3D |
| Disallow | /*index.php$ |
| Disallow | /auth/ |
| Disallow | *auth%3D |
| Disallow | /personal/ |
| Disallow | *register%3D |
| Disallow | *forgot_password%3D |
| Disallow | *change_password%3D |
| Disallow | *login%3D |
| Disallow | *logout%3D |
| Disallow | *action%3D |
| Disallow | *print%3D |
| Disallow | *?new=Y |
| Disallow | *?edit= |
| Disallow | *?preview= |
| Disallow | *backurl%3D |
| Disallow | *back_url%3D |
| Disallow | *back_url_admin%3D |
| Disallow | *captcha |
| Disallow | */feed |
| Disallow | */rss |
| Disallow | */filter/* |
| Disallow | *set_filter* |
| Disallow | *?p= |
| Disallow | *?q= |
| Disallow | *?tags= |
| Disallow | *B_ORDER%3D |
| Disallow | *clear_cache* |
| Disallow | *price_from%3D |
| Disallow | *price_to%3D |
| Disallow | *SECTION_ID%3D |
| Disallow | *SHOWALL%3D |
| Disallow | *SHOWBY%3D |
| Disallow | *SORT%3D |
| Disallow | *SPHRASE_ID%3D |
| Disallow | *utm* |
| Disallow | *openstat* |
| Disallow | *from%3D |
| Disallow | /order/ |
| Disallow | /sales/ |
| Disallow | /forum/ |
| Disallow | /cart/* |
| Disallow | /upload/*.csv |
| Disallow | /upload/*.xlsx |
| Disallow | /reviews/ |
| Disallow | /*?PAGEN_* |
| Disallow | /test/ |
yandex
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /bitrix/ |
| Disallow | *bitrix_*%3D |
| Disallow | /*index.php$ |
| Disallow | /auth/ |
| Disallow | *auth%3D |
| Disallow | /personal/ |
| Disallow | *register%3D |
| Disallow | *forgot_password%3D |
| Disallow | *change_password%3D |
| Disallow | *login%3D |
| Disallow | *logout%3D |
| Disallow | *action%3D |
| Disallow | *print%3D |
| Disallow | *?new=Y |
| Disallow | *?edit= |
| Disallow | *?preview= |
| Disallow | *backurl%3D |
| Disallow | *back_url%3D |
| Disallow | *back_url_admin%3D |
| Disallow | *captcha |
| Disallow | */feed |
| Disallow | */rss |
| Disallow | */filter/* |
| Disallow | *set_filter* |
| Disallow | *?p= |
| Disallow | *?q= |
| Disallow | *?tags= |
| Disallow | *B_ORDER%3D |
| Disallow | *clear_cache* |
| Disallow | *price_from%3D |
| Disallow | *price_to%3D |
| Disallow | *SECTION_ID%3D |
| Disallow | *SHOWALL%3D |
| Disallow | *SHOWBY%3D |
| Disallow | *SORT%3D |
| Disallow | *SPHRASE_ID%3D |
| Disallow | *utm* |
| Disallow | *openstat* |
| Disallow | *from%3D |
| Disallow | /order/ |
| Disallow | /sales/ |
| Disallow | /forum/ |
| Disallow | /cart/* |
| Disallow | /upload/*.csv |
| Disallow | /upload/*.xlsx |
| Disallow | /reviews/ |
| Disallow | /*?PAGEN_* |
| Disallow | /test/ |
googlebot
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /bitrix/ |
| Disallow | *bitrix_*%3D |
| Disallow | /*index.php$ |
| Disallow | /auth/ |
| Disallow | *auth%3D |
| Disallow | /personal/ |
| Disallow | *register%3D |
| Disallow | *forgot_password%3D |
| Disallow | *change_password%3D |
| Disallow | *login%3D |
| Disallow | *logout%3D |
| Disallow | *action%3D |
| Disallow | *print%3D |
| Disallow | *?new=Y |
| Disallow | *?edit= |
| Disallow | *?preview= |
| Disallow | *backurl%3D |
| Disallow | *back_url%3D |
| Disallow | *back_url_admin%3D |
| Disallow | *captcha |
| Disallow | */feed |
| Disallow | */rss |
| Disallow | */filter/* |
| Disallow | *set_filter* |
| Disallow | *?p= |
| Disallow | *?q= |
| Disallow | *?tags= |
| Disallow | *B_ORDER%3D |
| Disallow | *clear_cache* |
| Disallow | *price_from%3D |
| Disallow | *price_to%3D |
| Disallow | *SECTION_ID%3D |
| Disallow | *SHOWALL%3D |
| Disallow | *SHOWBY%3D |
| Disallow | *SORT%3D |
| Disallow | *SPHRASE_ID%3D |
| Disallow | *utm* |
| Disallow | *openstat* |
| Disallow | *from%3D |
| Disallow | /order/ |
| Disallow | /sales/ |
| Disallow | /forum/ |
| Disallow | /cart/* |
| Disallow | /upload/*.csv |
| Disallow | /upload/*.xlsx |
| Disallow | /reviews/ |
| Disallow | /*?PAGEN_* |
| Disallow | /test/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://tovarkran.ru/sitemap.xml |
Warnings
- `host` is not a known field.