Log In Sign Up

hyperinzerce.cz
robots.txt

Robots Exclusion Standard data for hyperinzerce.cz

Resource Scan

Scan Details

Site Domain hyperinzerce.cz
Base Domain hyperinzerce.cz
Scan Status Ok
Last Scan2024-06-26T21:32:25+00:00
Next Scan 2024-07-03T21:32:25+00:00

Last Scan

Scanned2024-06-26T21:32:25+00:00
URL https://hyperinzerce.cz/robots.txt
Domain IPs 20.50.2.26
Response IP 20.50.2.26
Found Yes
Hash 8805dcf3a9d4129398b3a7a9bbed271686edf5c338eba235dbefa8b3db1cb638
SimHash bb1c1803c8b2

Groups

*

Rule Path
Disallow /Error
Disallow /profil
Disallow /moje-zpravy
Disallow /oblibene-inzeraty
Disallow /osobni-udaje
Disallow /zmena-hesla

yandex

No rules defined. All paths allowed.

Other Records

Field Value Comment
crawl-delay 2 specifies a 2 second timeout

mj12bot
sogou spider
domaincrawler/3.0
linguee bot
semrushbot
semrushbot-sa
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
splitsignalbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://hyperinzerce.cz/sitemap.xml
Back to top

Comments

  • Specific bots which can't crawl site.
  • /robots.txt file for production environment
Back to top