pozdravsearch.ru
robots.txt
Robots Exclusion Standard data for pozdravsearch.ru
Resource Scan
Scan Details
Site Domain | pozdravsearch.ru |
Base Domain | pozdravsearch.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 5/22/2025, 8:06:32 PM |
Next Scan | 8/20/2025, 8:06:32 PM |
Last Successful Scan
Scanned | 10/31/2023, 6:38:07 PM |
URL | https://pozdravsearch.ru/robots.txt |
Domain IPs | 104.21.57.34, 172.67.188.237, 2606:4700:3031::ac43:bced, 2606:4700:3033::6815:3922 |
Response IP | 104.21.57.34 |
Found | Yes |
Hash | 989bbe58ae753ae04ead39e691ff76e83f9ea9c8cf12aeb08b46f9eefcba0e99 |
SimHash | 6e40dcb2a730 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.