kommunarka20.ru
robots.txt

Robots Exclusion Standard data for kommunarka20.ru

Resource Scan

Scan Details

Site Domain kommunarka20.ru
Base Domain kommunarka20.ru
Scan Status Ok
Last Scan2024-09-20T23:26:55+00:00
Next Scan 2024-10-20T23:26:55+00:00

Last Scan

Scanned2024-09-20T23:26:55+00:00
URL https://kommunarka20.ru/robots.txt
Domain IPs 104.21.42.109, 172.67.161.162, 2606:4700:3030::6815:2a6d, 2606:4700:3036::ac43:a1a2
Response IP 104.21.42.109
Found Yes
Hash 3d9b23bcdcce2101cc2af44704dc211e320dd8e75b47bb8948d5e20f106e2e4d
SimHash 5450dc624334

Groups

*

Rule Path
Disallow /cgi-bin

Other Records

Field Value
crawl-delay 2

Warnings

  • `host` is not a known field.