diskinternals.com
robots.txt
Robots Exclusion Standard data for diskinternals.com
Resource Scan
Scan Details
| Site Domain | diskinternals.com |
| Base Domain | diskinternals.com |
| Scan Status | Ok |
| Last Scan | 2025-12-19T19:37:30+00:00 |
| Next Scan | 2026-01-02T19:37:30+00:00 |
Last Scan
| Scanned | 2025-12-19T19:37:30+00:00 |
| URL | https://diskinternals.com/robots.txt |
| Redirect | https://www.diskinternals.com/robots.txt |
| Redirect Domain | www.diskinternals.com |
| Redirect Base | diskinternals.com |
| Domain IPs | 159.203.148.225, 2604:a880:800:c1::eb:1001 |
| Redirect IPs | 159.203.148.225, 2604:a880:800:c1::eb:1001 |
| Response IP | 159.203.148.225 |
| Found | Yes |
| Hash | 242bb54ea562e5f4828ea5bfabb1b671e02075b4b123de112523b61fd86ee2ab |
| SimHash | 407f5905e591 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /pad/ |
| Disallow | /order/* |
| Disallow | /search/ |
| Disallow | /search/* |
| Disallow | /?sa* |
| Disallow | /?ref* |
| Disallow | /?product* |
| Disallow | /?tag* |
| Disallow | /?title* |
| Disallow | /?source* |
| Disallow | /?amp=* |
| Disallow | /?source* |
| Disallow | /?utm* |
| Disallow | /?iframe* |
| Disallow | /?hash* |
| Disallow | /?vm* |
| Disallow | /?s=* |
| Disallow | /?sa=* |
| Disallow | /?_gl=* |
| Disallow | /*?product* |
| Disallow | /*?file* |
| Disallow | /*?ht* |
| Disallow | /*?utm_source* |
| Allow | / |
googlebot
| Rule | Path |
|---|---|
| Disallow | /pad/ |
| Disallow | /order/* |
| Disallow | /?sa* |
| Disallow | /?ref* |
| Disallow | /?product* |
| Disallow | /?tag* |
| Disallow | /?title* |
| Disallow | /?source* |
| Disallow | /?amp=* |
| Disallow | /?source* |
| Disallow | /?utm* |
| Disallow | /?iframe* |
| Disallow | /?hash* |
| Disallow | /?vm* |
| Disallow | /?s=* |
| Disallow | /?sa=* |
| Disallow | /?_gl=* |
| Disallow | /*?product* |
| Disallow | /*?file* |
| Disallow | /*?ht* |
| Disallow | /*?utm_source* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.diskinternals.com/sitemap.xml |