pocasi-online.cz
robots.txt

Robots Exclusion Standard data for pocasi-online.cz

Resource Scan

Scan Details

Site Domain pocasi-online.cz
Base Domain pocasi-online.cz
Scan Status Ok
Last Scan2024-11-13T17:00:44+00:00
Next Scan 2024-11-20T17:00:44+00:00

Last Scan

Scanned2024-11-13T17:00:44+00:00
URL http://pocasi-online.cz/robots.txt
Redirect https://meteobox.cz/robots.txt
Redirect Domain meteobox.cz
Redirect Base meteobox.cz
Domain IPs 217.11.235.79
Redirect IPs 217.11.235.78
Response IP 217.11.235.78
Found Yes
Hash 5b827563d0ebcbdff72ee0600fc38e3a3b209ba987008d5ba605ade4c18da4c4
SimHash 7a1e50c0e098

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /api/*
Disallow *d%3D*
Disallow *flavour%3D*
Disallow /po-*
Disallow /err/*
Disallow *adv_noview%3Dall
Disallow /json/*
Disallow /post-data/*

yandexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

bingbot
semrushbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

aspiegelbot
seznambot
blexbot
dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot
seokicks

Rule Path
Disallow /

msnbot
gptbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ttd-content

Rule Path
Disallow /

proximic

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

senutobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://meteobox.cz/siteindex.xml

Comments

  • nove views.py re_robot_no_yrno
  • Crawl-delay: 60
  • Disallow: /
  • User-agent: BingPreview
  • Disallow: /
  • User-agent: AhrefsBot
  • Disallow: /
  • Request-rate: 500/1d
  • Request-rate: 500/1d
  • Request-rate: 500/1d

Warnings

  • `request-rate` is not a known field.