amaazoon.ru
robots.txt
Robots Exclusion Standard data for amaazoon.ru
Resource Scan
Scan Details
| Site Domain | amaazoon.ru |
| Base Domain | amaazoon.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-03T02:35:16+00:00 |
| Next Scan | 2024-12-03T02:35:16+00:00 |
Last Scan
| Scanned | 2024-11-03T02:35:16+00:00 |
| URL | https://amaazoon.ru/robots.txt |
| Domain IPs | 213.136.75.193 |
| Response IP | 213.136.75.193 |
| Found | Yes |
| Hash | 48e65cce70c88aa19c286081091f0e8cd5509f775d3f43e42a5721dedc60cb33 |
| SimHash | bdd1d983c237 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /amazon/foreignbooks |
| Disallow | /privacy-policy |
| Disallow | /agb |
| Disallow | /newsletter_activate |
| Disallow | /activation |
| Disallow | /login |
| Disallow | /recover |
| Disallow | /cart |
| Disallow | /reviews/add |
| Disallow | /account |
| Disallow | *.pdf$ |
| Disallow | /500.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3.0 |
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /amazon/foreignbooks |
| Disallow | /privacy-policy |
| Disallow | /agb |
| Disallow | /newsletter_activate |
| Disallow | /activation |
| Disallow | /login |
| Disallow | /recover |
| Disallow | /cart |
| Disallow | /reviews/add |
| Disallow | /account |
| Disallow | *.pdf$ |
| Disallow | /*sort%3D* |
| Disallow | /*price%5Bmin%5D%3D* |
| Disallow | /*price%5Bmax%5D%3D* |
| Disallow | /*brand%5B%5D%3D* |
| Disallow | /*color%5B%5D%3D* |
| Disallow | /*size%5B%5D%3D* |
| Disallow | /*srsltid%3D* |
| Disallow | /500.html |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.