dialog-it.ru
robots.txt

Robots Exclusion Standard data for dialog-it.ru

Resource Scan

Scan Details

Site Domain dialog-it.ru
Base Domain dialog-it.ru
Scan Status Ok
Last Scan2025-08-21T23:37:54+00:00
Next Scan 2025-09-20T23:37:54+00:00

Last Scan

Scanned2025-08-21T23:37:54+00:00
URL https://www.dialog-it.ru/robots.txt
Redirect http://www.dialog-it.ru/robots.txt
Domain IPs 91.227.140.76
Response IP 91.227.140.76
Found Yes
Hash 15584c1b064426ff035bcefc803b23ec91b2b5c43353473dc044b350e0258fd7
SimHash 3348abc64e9a

Groups

*

Rule Path
Disallow /assets/backup/
Disallow /assets/cache/
Disallow /assets/docs/
Disallow /assets/export/
Disallow /assets/import/
Disallow /assets/modules/
Disallow /assets/plugins/
Disallow /assets/snippets/
Disallow /assets/packages/
Disallow /assets/tvs/
Disallow /install/
Allow /assets/cache/images/
Allow /assets/modules/*.css
Allow /assets/modules/*.js
Allow /assets/plugins/*.css
Allow /assets/plugins/*.js
Allow /assets/snippets/*.css
Allow /assets/snippets/*.js

Comments

  • Default modx exclusions
  • Host: example.com
  • For sitemaps.xml autodiscovery. Uncomment if you have one:
  • Sitemap: http://example.com/sitemap.xml