sputnik.ru
robots.txt

Robots Exclusion Standard data for sputnik.ru

Resource Scan

Scan Details

Site Domain sputnik.ru
Base Domain sputnik.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2024-04-22T08:54:31+00:00
Next Scan 2024-07-21T08:54:31+00:00

Last Successful Scan

Scanned2023-06-27T09:17:42+00:00
URL https://sputnik.ru/robots.txt
Redirect https://www.sputnik.ru/robots.txt
Redirect Domain www.sputnik.ru
Redirect Base sputnik.ru
Domain IPs 5.143.224.19
Redirect IPs 5.143.224.19
Response IP 5.143.224.19
Found Yes
Hash e2da9d74f092be73679d325149dcb51c8d280bdcb8f5deb9cbc30eb7fb10936c
SimHash 4c509e62c731

Groups

*

Rule Path
Allow /$
Disallow /

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.