defend.sk
robots.txt

Robots Exclusion Standard data for defend.sk

Resource Scan

Scan Details

Site Domain defend.sk
Base Domain defend.sk
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-09-30T08:11:08+00:00
Next Scan 2025-10-07T08:11:08+00:00

Last Successful Scan

Scanned2025-08-30T08:10:27+00:00
URL http://defend.sk/robots.txt
Redirect http://defend.cz/robots.txt
Redirect Domain defend.cz
Redirect Base defend.cz
Domain IPs 85.93.165.117
Redirect IPs 3.125.172.46, 3.73.27.108
Response IP 3.125.172.46
Found Yes
Hash eb815117e9721c93fda0a832ee31fb28d85a0a37e288ba741d69bbf856c84102
SimHash 6954d87083a3

Groups

psbot

Rule Path
Disallow /

*

Rule Path
Disallow /servers/frontend/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap http://defend.cz/sitemap.xml