netkatalog.cz
robots.txt

Robots Exclusion Standard data for netkatalog.cz

Resource Scan

Scan Details

Site Domain netkatalog.cz
Base Domain netkatalog.cz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-02-15T02:06:00+00:00
Next Scan 2025-05-16T02:06:00+00:00

Last Successful Scan

Scanned2024-04-21T19:47:37+00:00
URL https://netkatalog.cz/robots.txt
Redirect https://www.netkatalog.cz/robots.txt
Redirect Domain www.netkatalog.cz
Redirect Base netkatalog.cz
Domain IPs 104.21.25.81, 172.67.133.199, 2606:4700:3035::ac43:85c7, 2606:4700:3036::6815:1951
Redirect IPs 104.21.25.81, 172.67.133.199, 2606:4700:3035::ac43:85c7, 2606:4700:3036::6815:1951
Response IP 172.67.133.199
Found Yes
Hash 399a5825db758530fe340d627912b0211d5461e8f8bfd132911d682f7ceebad7
SimHash 6f015855e371

Groups

*

Rule Path
Disallow /hledani/
Disallow /*?*do=
Disallow /*?*fid=

yandex

Rule Path
Disallow /hledani/
Disallow /*?*do=
Disallow /*?*fid=

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.netkatalog.cz/sitemaps/sitemap_index.xml

Comments

  • robots.txt
  • User-agent: Bingbot
  • Crawl-delay: 5
  • Disallow: /hledani/