Log In Sign Up

country.db.com
robots.txt

Robots Exclusion Standard data for country.db.com

Resource Scan

Scan Details

Site Domain country.db.com
Base Domain db.com
Scan Status Ok
Last Scan2026-01-26T04:50:46+00:00
Next Scan 2026-02-25T04:50:46+00:00

Last Scan

Scanned2026-01-26T04:50:46+00:00
URL https://country.db.com/robots.txt
Domain IPs 34.36.212.109
Response IP 34.36.212.109
Found Yes
Hash 98cbef0346a3c27e042a6edd11753fecd9f900759065ec8809e5e70111a2d93e
SimHash 2010d726a6f0

Groups

*

Rule Path
Allow /*?language_id=1$
Allow /*?language_id=3$
Disallow /?language_id=1
Disallow /?language_id=3
Disallow /article-detail?language_id=1
Disallow /article-detail?language_id=3
Allow /*.docx$
Allow /*.gif$
Allow /*.ico$
Allow /*.jpeg$
Allow /*.jpg$
Allow /*.pdf$
Allow /*.png$
Allow /*.svg$
Allow /*.txt$
Allow /*.xlsx$
Disallow /z-test-area/
Disallow /*kid%3D
Disallow /*trk%3D
Disallow /*.htm$
Disallow /*.html$
Allow /static/index.html
Back to top

Comments

  • Disallow: /
  • Disallow: /application/
  • Allow: /application/project/js/*.js
  • Allow: /application/project/css/*.css
  • Blocks all URLs with UTMs
  • Blocks legacy URLs ending with .htm or .html with one exception
Back to top