checkdi.com
robots.txt

Robots Exclusion Standard data for checkdi.com

Resource Scan

Scan Details

Site Domain checkdi.com
Base Domain checkdi.com
Scan Status Ok
Last Scan2026-01-18T21:35:16+00:00
Next Scan 2026-02-17T21:35:16+00:00

Last Scan

Scanned2026-01-18T21:35:16+00:00
URL https://checkdi.com/robots.txt
Domain IPs 172.66.40.174, 172.66.43.82, 2606:4700:3108::ac42:28ae, 2606:4700:3108::ac42:2b52
Response IP 172.66.43.82
Found Yes
Hash 8d21f23dca461a9d21627ac92321ddbe4ad480324e4dae2e978f20e81435bed1
SimHash 6d1d5410c1c2

Groups

*

Rule Path
Disallow /backend
Disallow /others
Disallow /projects/max/backend
Disallow /webservice
Disallow /Content
Disallow /apiws
Disallow /go.aspx
Disallow /tools

Other Records

Field Value
sitemap https://checkdi.com/sitemapindex.xml

Comments

  • Main domain rules
  • Main domain sitemap