cargo-express.ru
robots.txt
Robots Exclusion Standard data for cargo-express.ru
Resource Scan
Scan Details
| Site Domain | cargo-express.ru |
| Base Domain | cargo-express.ru |
| Scan Status | Ok |
| Last Scan | 2026-02-04T11:17:49+00:00 |
| Next Scan | 2026-03-06T11:17:49+00:00 |
Last Scan
| Scanned | 2026-02-04T11:17:49+00:00 |
| URL | https://cargo-express.ru/robots.txt |
| Domain IPs | 193.168.131.82 |
| Response IP | 193.168.131.82 |
| Found | Yes |
| Hash | a5ee91644fdf1498ab574c322ad4868f8779f6558a6f1aeaaede420bfec5ddc0 |
| SimHash | 4d195c44e8f5 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /? |
| Disallow | /notfound/ |
| Disallow | /admin |
| Disallow | /index.php |
| Disallow | /emarket/addToCompare |
| Disallow | /emarket/basket |
| Disallow | /go_out.php |
| Disallow | /search |
| Disallow | /banners/ |
| Disallow | /payment/fail/ |
| Disallow | /payment/success/ |
yandex
| Rule | Path |
|---|---|
| Disallow | /? |
| Disallow | /notfound/ |
| Disallow | /admin |
| Disallow | /index.php |
| Disallow | /emarket/addToCompare |
| Disallow | /emarket/basket |
| Disallow | /go_out.php |
| Disallow | /search |
| Disallow | /banners/ |
| Disallow | /payment/fail/ |
| Disallow | /payment/success/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
*
| Rule | Path |
|---|---|
| Disallow | /? |
| Disallow | /notfound/ |
| Disallow | /admin |
| Disallow | /index.php |
| Disallow | /emarket/addToCompare |
| Disallow | /emarket/basket |
| Disallow | /go_out.php |
| Disallow | /search |
| Disallow | /banners/ |
| Disallow | /payment/fail/ |
| Disallow | /payment/success/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://cargo-express.ru/sitemap.xml |