web6.ru
robots.txt

Robots Exclusion Standard data for web6.ru

Resource Scan

Scan Details

Site Domain web6.ru
Base Domain web6.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-24T13:40:47+00:00
Next Scan 2026-04-24T13:40:47+00:00

Last Successful Scan

Scanned2025-06-06T12:54:21+00:00
URL https://web6.ru/robots.txt
Domain IPs 217.71.231.2
Response IP 217.71.231.2
Found Yes
Hash 67bd626ff79b88253feb6fb50e0d5e7e03d0e0fd6adbd495ae7f0b2e70f27cf7
SimHash 5d41cd634193

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /css/

yandex

Rule Path
Disallow /cgi-bin/
Disallow /css/

Warnings

  • `host` is not a known field.