crdf.ru
robots.txt

Robots Exclusion Standard data for crdf.ru

Resource Scan

Scan Details

Site Domain crdf.ru
Base Domain crdf.ru
Scan Status Ok
Last Scan4/5/2025, 7:12:31 AM
Next Scan 4/12/2025, 7:12:31 AM

Last Scan

Scanned4/5/2025, 7:12:31 AM
URL http://crdf.ru/robots.txt
Domain IPs 94.130.130.126
Response IP 94.130.130.126
Found Yes
Hash bdbfaca79d22b351b296a749b72e24d2388620c5d03f9f9d956d43092fe337aa
SimHash 63509f424733

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap http://crdf.ru/sitemap.xml

Warnings

  • `host` is not a known field.