techsvet.cz
robots.txt

Robots Exclusion Standard data for techsvet.cz

Resource Scan

Scan Details

Site Domain techsvet.cz
Base Domain techsvet.cz
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-05-16T02:32:58+00:00
Next Scan 2024-08-14T02:32:58+00:00

Last Successful Scan

Scanned2023-10-20T01:37:40+00:00
URL https://techsvet.cz/robots.txt
Domain IPs 45.138.107.27, 45.138.107.28
Response IP 45.138.107.28
Found Yes
Hash deb49f38552e339af15afaf14538279252ca2e6b746f31231ebb89e67b6ae9f1
SimHash 6c2dcd059987

Groups

seznambot

Rule Path
Disallow /cz/chat/

googlebot

Rule Path
Disallow /logs/

Other Records

Field Value
sitemap https://techsvet.cz/sitemap.xml

Comments

  • pro SeznamBota: neprohledávat /cz/chat/, rychlost 10 URL za minutu
  • pro Googlebota: neprohledávat /logs/, rychlost 10 URL za minutu

Warnings

  • `request-rate` is not a known field.