rcde.ru
robots.txt

Robots Exclusion Standard data for rcde.ru

Resource Scan

Scan Details

Site Domain rcde.ru
Base Domain rcde.ru
Scan Status Ok
Last Scan2024-11-14T01:41:57+00:00
Next Scan 2024-11-21T01:41:57+00:00

Last Scan

Scanned2024-11-14T01:41:57+00:00
URL https://rcde.ru/robots.txt
Domain IPs 2a00:15f8:a000:5:1:11:0:3f08, 2a00:15f8:a000:5:1:12:0:3f08, 2a00:15f8:a000:5:1:13:0:3f08, 2a00:15f8:a000:5:1:14:0:3f08, 90.156.201.34, 90.156.201.46, 90.156.201.51, 90.156.201.60
Response IP 90.156.201.34
Found Yes
Hash 82f23089c271fdb2f632492f53505885b648ed7eb88406869d6cace4f3547b72
SimHash 4440c5244115

Groups

*

Rule Path
Disallow /reg
Disallow /admin
Disallow */ht

slurp
msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 1000

Warnings

  • `host` is not a known field.