prozeny.cz
robots.txt

Robots Exclusion Standard data for prozeny.cz

Resource Scan

Scan Details

Site Domain prozeny.cz
Base Domain prozeny.cz
Scan Status Ok
Last Scan2024-05-22T00:53:27+00:00
Next Scan 2024-05-29T00:53:27+00:00

Last Scan

Scanned2024-05-22T00:53:27+00:00
URL https://prozeny.cz/robots.txt
Redirect https://www.prozeny.cz/robots.txt
Redirect Domain www.prozeny.cz
Redirect Base prozeny.cz
Domain IPs 2a02:598:2::107, 2a02:598:a::78:107, 77.75.76.107, 77.75.78.107
Redirect IPs 2a02:598:2::107, 2a02:598:a::78:107, 77.75.76.107, 77.75.78.107
Response IP 77.75.78.107
Found Yes
Hash 5939c33385c2261e0c848f3de72638043f7752598eeced5bb25a5dac3833cd9c
SimHash 40111333860b

Groups

*

Rule Path
Disallow /clanek/*timeline--pageItem%3D
Disallow /*mol-gallery--expanded%3D
Disallow /*mol-gallery--selected%3D
Disallow /*fts--order%3Dalphabetical-desc
Disallow /*fts--order%3Daccept-time-desc
Disallow /*fts--order%3Daccept-time-asc
Disallow /*fts--order%3Dranking-asc
Disallow /*fts--order%3Dranking-desc
Disallow /*fts--order%3Drandom
Disallow /*fts--search%3D
Disallow /*ogm-tag-list--pages
Disallow /*ogm-search-feed--pages
Disallow /*previewToken%3D
Disallow /*bankid%3D
Disallow /*mol-foods-table--page%3D
Disallow /recepty-hledani
Disallow /zdravi-hledani
Disallow /potraviny-hledani
Disallow /*rq%3D
Disallow /*horoscopeSign%3D
Disallow /*search-bar--opened%3D
Disallow /*servingsAmount%3D
Disallow /*ribbon--menu%3D
Disallow /*ribbon--search%3D
Disallow /*menu--open

seznamsocialbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.prozeny.cz/sitemaps/sitemap_articles.xml
sitemap https://www.prozeny.cz/sitemaps/sitemap_news.xml
sitemap https://www.prozeny.cz/sitemaps/sitemap_sections.xml
sitemap https://www.prozeny.cz/sitemaps/sitemap_daily_horoscopes.xml
sitemap https://www.prozeny.cz/sitemaps/sitemap_tags.xml

Comments

  • dont crawl pagination on article pages
  • dont crawl the same page with opened gallery
  • from gallery in newsfeed
  • category of photo contests
  • pagination for health category
  • pagination to search in a category
  • article preview
  • search page for ingredients and food
  • dont crawl results of search
  • dont crawl pages with URL params for transfer user action from AMP version | legacy
  • legacy parameters
  • historical parameters
  • social profile preview tab