pozdravsearch.ru
robots.txt

Robots Exclusion Standard data for pozdravsearch.ru

Resource Scan

Scan Details

Site Domain pozdravsearch.ru
Base Domain pozdravsearch.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan5/22/2025, 8:06:32 PM
Next Scan 8/20/2025, 8:06:32 PM

Last Successful Scan

Scanned10/31/2023, 6:38:07 PM
URL https://pozdravsearch.ru/robots.txt
Domain IPs 104.21.57.34, 172.67.188.237, 2606:4700:3031::ac43:bced, 2606:4700:3033::6815:3922
Response IP 104.21.57.34
Found Yes
Hash 989bbe58ae753ae04ead39e691ff76e83f9ea9c8cf12aeb08b46f9eefcba0e99
SimHash 6e40dcb2a730

Groups

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 8

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.