Log In Sign Up

autobazar.hyperinzerce.cz
robots.txt

Robots Exclusion Standard data for autobazar.hyperinzerce.cz

Resource Scan

Scan Details

Site Domain autobazar.hyperinzerce.cz
Base Domain hyperinzerce.cz
Scan Status Ok
Last Scan2025-04-21T10:51:16+00:00
Next Scan 2025-05-21T10:51:16+00:00

Last Scan

Scanned2025-04-21T10:51:16+00:00
URL https://autobazar.hyperinzerce.cz/robots.txt
Domain IPs 20.50.2.26
Response IP 20.50.2.26
Found Yes
Hash 5498655262e7cecb1280bb3fe6e532ec26606cfb40899e5120ec997624fcc84f
SimHash b91c1882c8b2

Groups

*

Rule Path
Disallow /Error
Disallow /profil
Disallow /moje-zpravy
Disallow /oblibene-inzeraty
Disallow /osobni-udaje
Disallow /zmena-hesla
Disallow /*/technicka-podpora/?id_inzeratu=

yandex

No rules defined. All paths allowed.

Other Records

Field Value Comment
crawl-delay 2 specifies a 2 second timeout

mj12bot
sogou spider
domaincrawler/3.0
linguee bot
semrushbot
semrushbot-sa
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
splitsignalbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://autobazar.hyperinzerce.cz/sitemap.xml
Back to top

Comments

  • Specific bots which can't crawl site.
  • /robots.txt file for production environment
Back to top