yaroslavl.trial-market.ru
robots.txt
Robots Exclusion Standard data for yaroslavl.trial-market.ru
Resource Scan
Scan Details
| Site Domain | yaroslavl.trial-market.ru |
| Base Domain | trial-market.ru |
| Scan Status | Ok |
| Last Scan | 2024-10-31T19:30:04+00:00 |
| Next Scan | 2024-11-30T19:30:04+00:00 |
Last Scan
| Scanned | 2024-10-31T19:30:04+00:00 |
| URL | https://yaroslavl.trial-market.ru/robots.txt |
| Domain IPs | 158.160.157.111 |
| Response IP | 158.160.157.111 |
| Found | Yes |
| Hash | 5fc8d42b085af956f27bd346fa013033a5c000ec63c0b20564bc196131e45a15 |
| SimHash | dd588800bf33 |
Groups
yandex
| Rule | Path |
|---|---|
| Allow | *.css |
| Allow | *.js |
| Disallow | */download/ |
| Disallow | /forgotpassword/ |
| Disallow | /user-agreement.html |
| Disallow | /registration/ |
| Disallow | /catalog-request.html |
| Disallow | /offers/ |
| Disallow | /captcha/ |
| Disallow | /contact/ |
| Disallow | /test-produktsii/ |
| Disallow | /priglasit-na-tender/ |
| Disallow | /login/ |
| Disallow | /brands/*/items/ |
| Disallow | /*available%3D |
| Disallow | /*display%3D |
| Disallow | /*order%3D |
| Disallow | /*in_stock%3D |
| Disallow | /wishlist* |
| Disallow | /cart* |
| Disallow | /order* |
| Disallow | */new/* |
| Disallow | /cabinet/* |
| Disallow | */sale/* |
| Disallow | /sale/*? |
| Disallow | /products/*?page=* |
| Disallow | *?yadclid |
| Disallow | *?etext= |
| Disallow | *filter* |
| Disallow | *%26r%3D |
| Disallow | /tag/*?page=0 |
| Disallow | /api/ |
| Disallow | /11-11/ |
| Disallow | *? |
| Allow | *page%3D* |
| Disallow | *?r&page* |
| Disallow | *?*limit=* |
| Disallow | /search/ |
| Disallow | /poslednyaya-tsena/ |
googlebot
| Rule | Path |
|---|---|
| Allow | *.css |
| Allow | *.js |
| Disallow | */download/ |
| Disallow | /forgotpassword/ |
| Disallow | /user-agreement.html |
| Disallow | /registration/ |
| Disallow | /catalog-request.html |
| Disallow | /offers/ |
| Disallow | /captcha/ |
| Disallow | /contact/ |
| Disallow | /test-produktsii/ |
| Disallow | /priglasit-na-tender/ |
| Disallow | /login/ |
| Disallow | /restricted/ |
| Disallow | /brands/*/items/ |
| Disallow | /*available%3D |
| Disallow | /*display%3D |
| Disallow | /*order%3D |
| Disallow | /*in_stock%3D |
| Disallow | /wishlist* |
| Disallow | /cart* |
| Disallow | /order* |
| Disallow | */new/* |
| Disallow | /cabinet/* |
| Disallow | */sale/* |
| Disallow | /sale/*? |
| Disallow | *? |
| Disallow | *?*limit=* |
| Disallow | /products/*?page=* |
| Disallow | *?yadclid |
| Disallow | *?etext= |
| Disallow | *filter* |
| Disallow | *%26r%3D |
| Disallow | /tag/*?page=0 |
| Disallow | /api/ |
| Disallow | /11-11/ |
| Disallow | /poslednyaya-tsena/ |
| Allow | *page%3D* |
| Disallow | *?r&page* |
*
| Rule | Path |
|---|---|
| Allow | *.css |
| Allow | *.js |
| Disallow | */download/ |
| Disallow | /forgotpassword/ |
| Disallow | /user-agreement.html |
| Disallow | /registration/ |
| Disallow | /catalog-request.html |
| Disallow | /offers/ |
| Disallow | /captcha/ |
| Disallow | /contact/ |
| Disallow | /test-produktsii/ |
| Disallow | /priglasit-na-tender/ |
| Disallow | /login/ |
| Disallow | /brands/*/items/ |
| Disallow | /*available%3D |
| Disallow | /*display%3D |
| Disallow | /*order%3D |
| Disallow | /*in_stock%3D |
| Disallow | /wishlist* |
| Disallow | /cart* |
| Disallow | /order* |
| Disallow | */new/* |
| Disallow | /cabinet/* |
| Disallow | */sale/* |
| Allow | /sale/ |
| Disallow | /sale/*? |
| Disallow | *? |
| Disallow | /products/*?page=* |
| Disallow | *?yadclid |
| Disallow | *?etext= |
| Disallow | *filter* |
| Disallow | *%26r%3D |
| Disallow | /tag/*?page=0 |
| Disallow | /api/ |
| Disallow | /11-11/ |
| Disallow | /poslednyaya-tsena/ |
| Allow | *page%3D* |
| Disallow | *?r&page* |
| Disallow | *?*limit=* |
| Disallow | /search/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://yaroslavl.trial-market.ru/yaroslavl-sitemap.xml.gz |
| sitemap | https://yaroslavl.trial-market.ru/yaroslavl-sitemap.xml.gz |
| sitemap | https://yaroslavl.trial-market.ru/yaroslavl-sitemap.xml.gz |
Warnings
- `clean-param` is not a known field.