iqlandia.cz
robots.txt

Robots Exclusion Standard data for iqlandia.cz

Resource Scan

Scan Details

Site Domain iqlandia.cz
Base Domain iqlandia.cz
Scan Status Ok
Last Scan2025-03-06T12:49:36+00:00
Next Scan 2025-04-05T12:49:36+00:00

Last Scan

Scanned2025-03-06T12:49:36+00:00
URL https://iqlandia.cz/robots.txt
Domain IPs 37.205.13.201
Response IP 37.205.13.201
Found Yes
Hash abbc87cfa5839b1c81f2db278f6ebd87e5dc24172580959e021779a8cc3a5646
SimHash 6e3dfb3056fb

Groups

*

Rule Path
Disallow /application/attributes/
Disallow /application/authentication/
Disallow /application/bootstrap/
Disallow /application/config/
Disallow /application/controllers/
Disallow /application/elements/
Disallow /application/helpers/
Disallow /application/jobs/
Disallow /application/languages/
Disallow /application/mail/
Disallow /application/models/
Disallow /application/page_types/
Disallow /application/single_pages/
Disallow /application/tools/
Disallow /application/views/
Disallow /concrete/*.php
Disallow /concrete/*.xml
Disallow /updates/*/concrete/*.php
Disallow /updates/*/concrete/*.xml
Disallow /%21trash/*
Disallow /ccm/
Disallow /download_file/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /search
Disallow /login
Disallow /register
Disallow /admin
Disallow /user
Disallow /*.php$
Disallow /*.cgi$
Disallow /*.pl$
Disallow /*.txt$

Other Records

Field Value
crawl-delay 10

badbot

Rule Path
Disallow /

evilscraper

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://iqlandia.cz/sitemap.xml

Comments

  • Directories
  • Paths (clean URLs)
  • Files
  • Sitemap
  • Crawl delay to prevent server overload
  • Blocking specific bots
  • Allow all other bots