superlink.cz
robots.txt

Robots Exclusion Standard data for superlink.cz

Resource Scan

Scan Details

Site Domain superlink.cz
Base Domain superlink.cz
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-21T19:59:19+00:00
Next Scan 2024-11-20T19:59:19+00:00

Last Successful Scan

Scanned2024-09-22T19:54:59+00:00
URL https://superlink.cz/robots.txt
Redirect http://www.superlink.cz/robots.txt
Redirect Domain www.superlink.cz
Redirect Base superlink.cz
Domain IPs 45.138.107.33, 45.138.107.34
Redirect IPs 45.138.107.33, 45.138.107.34
Response IP 45.138.107.34
Found Yes
Hash 2ee7696c81383db8cc73b194fec3730fcc76012e5a5a7dc1ba8500aeecf14ba0
SimHash e8009872c7b3

Groups

*

Rule Path
Allow /
Disallow

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap http://www.superlink.cz/sitemap.xml

Warnings

  • `request-rate` is not a known field.