direct.yandex.ru
robots.txt
Robots Exclusion Standard data for direct.yandex.ru
Resource Scan
Scan Details
Site Domain | direct.yandex.ru |
Base Domain | yandex.ru |
Scan Status | Ok |
Last Scan | 2024-06-04T21:39:43+00:00 |
Next Scan | 2024-06-18T21:39:43+00:00 |
Last Scan
Scanned | 2024-06-04T21:39:43+00:00 |
URL | https://direct.yandex.ru/robots.txt |
Domain IPs | 87.250.250.134 |
Response IP | 87.250.250.134 |
Found | Yes |
Hash | 9473fd5a41f6c4d1922f31e17a720d5ecdbb4f17e275fed051a42adf3f7e2e13 |
SimHash | ecdebd2b46d9 |
Groups
*
Rule | Path |
---|---|
Disallow | /registered/ |
Disallow | /popupdisabledIps.html?disabledIps= |
Disallow | /servicing?thanks=1 |
Disallow | /?add-half |
Disallow | /?top |
Disallow | |
Disallow | /?hnt= |
Disallow | /regions.html |
Disallow | /direct.xls |
Disallow | /oferta.rtf |
Disallow | /stat/ |
Disallow | /search |
Disallow | /welcome-thanks.html |
Disallow | /commander-old/ |
Disallow | /commander-old |
Disallow | /dna |
Warnings
- `host` is not a known field.