hd-dfs.com
robots.txt
Robots Exclusion Standard data for hd-dfs.com
Resource Scan
Scan Details
| Site Domain | hd-dfs.com |
| Base Domain | hd-dfs.com |
| Scan Status | Ok |
| Last Scan | 2024-11-14T00:33:23+00:00 |
| Next Scan | 2024-12-14T00:33:23+00:00 |
Last Scan
| Scanned | 2024-11-14T00:33:23+00:00 |
| URL | https://www.hd-dfs.com/robots.txt |
| Domain IPs | 132.147.114.72 |
| Response IP | 132.147.114.72 |
| Found | Yes |
| Hash | 59dc1e97a3b2e62a489c76c3118f10d9d280450d6dbd497189dfcca9b875b7aa |
| SimHash | e52cd552e3b4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /shop/mm/ |
| Disallow | /shop/cm/ |
| Disallow | /shop/or/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |