stev.kndr-torrent.ru
robots.txt

Robots Exclusion Standard data for stev.kndr-torrent.ru

Resource Scan

Scan Details

Site Domain stev.kndr-torrent.ru
Base Domain kndr-torrent.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-04T10:49:18+00:00
Next Scan 2026-01-02T10:49:18+00:00

Last Successful Scan

Scanned2024-08-17T21:19:46+00:00
URL https://stev.kndr-torrent.ru/robots.txt
Domain IPs 104.21.75.117, 172.67.223.82, 2606:4700:3032::6815:4b75, 2606:4700:3035::ac43:df52
Response IP 104.21.75.117
Found Yes
Hash f24b8760ece4d9aa6057decba2d1298fab922180443901af86b4387cba1fcbe7
SimHash 6a104cd28331

Groups

*

Rule Path
Disallow /new11/
Disallow /newCache/
Disallow /topCache/
Disallow /inc/checkcache/
Disallow /inc/recache/
Disallow /redirect/
Disallow /parse/d.rutor.org/download/

Other Records

Field Value
crawl-delay 0.5

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.