machinedesign.com
robots.txt
Robots Exclusion Standard data for machinedesign.com
Resource Scan
Scan Details
Site Domain | machinedesign.com |
Base Domain | machinedesign.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-08-29T16:39:24+00:00 |
Next Scan | 2025-09-05T16:39:24+00:00 |
Last Successful Scan
Scanned | 2025-07-28T13:31:37+00:00 |
URL | https://machinedesign.com/robots.txt |
Redirect | https://www.machinedesign.com/robots.txt |
Redirect Domain | www.machinedesign.com |
Redirect Base | machinedesign.com |
Domain IPs | 89.106.200.1 |
Redirect IPs | 104.18.28.78, 104.18.29.78, 2606:4700::6812:1c4e, 2606:4700::6812:1d4e |
Response IP | 104.18.28.78 |
Found | Yes |
Hash | cfc74d4e7b713b5c381287927d223a21e6edbf29f31eddd67dd136fe76e70e9b |
SimHash | 68284d448991 |
Other Records
Field | Value |
---|---|
sitemap | https://www.machinedesign.com/sitemap.xml |
sitemap | https://www.machinedesign.com/sitemap-google-news.xml |