hardwarezone.com
robots.txt
Robots Exclusion Standard data for hardwarezone.com
Resource Scan
Scan Details
Site Domain | hardwarezone.com |
Base Domain | hardwarezone.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-06T11:45:26+00:00 |
Next Scan | 2025-02-04T11:45:26+00:00 |
Last Successful Scan
Scanned | 2024-07-10T11:36:22+00:00 |
URL | https://hardwarezone.com/robots.txt |
Redirect | https://www.hardwarezone.com.sg/robots.txt |
Redirect Domain | www.hardwarezone.com.sg |
Redirect Base | hardwarezone.com.sg |
Domain IPs | 108.156.133.115, 108.156.133.66, 108.156.133.8, 108.156.133.90 |
Redirect IPs | 152.195.221.44 |
Response IP | 152.195.221.44 |
Found | Yes |
Hash | 8825c13e6ce9d28c5b40b13326b97acacb02063b2da39d80d9c2f9dc9b1bdc85 |
SimHash | 2b101a42a403 |
Groups
*
Rule | Path |
---|---|
Disallow | /pages/mobile_home/ |
Disallow | /videos/mobile_index/ |
Disallow | /search/ |
Disallow | /product-guide/0/ |
Disallow | /product-guide/0-/ |
Disallow | /product-guide/Array/ |
Disallow | /product-guide/s/ |
Disallow | /price-guide/0/ |
Disallow | /price-guide/0-/ |
Disallow | /price-guide/Array/ |
Disallow | /price-guide/s/ |
Disallow | /techshow-portal/ |
Disallow | /marketplace/edit/ |
Disallow | /marketplace/list_open |
Disallow | /marketplace/list_closed |
Disallow | /webroot/index.php |
Disallow | /product-guide/list/list/ |
Disallow | /price-guide/list/list/ |
Disallow | /blogs/tagged/0-/ |
Disallow | /product-guide/all/reviews/tagged/0-/ |
Disallow | /product-guide/all/reviews/tagged/0/ |
Disallow | /product-guide/all/tagged/0-/ |
Disallow | /product-guide/all/tagged/13-/ |
Disallow | /product-guide/reviews/Array/ |
Disallow | /product-guide/13/ |
Disallow | /product-guide/17/ |
Disallow | /product-guide/18/ |
Disallow | /product-guide/19/ |
Disallow | /product-guide/153/ |
Disallow | /product-guide/234/ |
Disallow | /product-guide/400/ |
Disallow | /products/listing/cat%3AArray/ |
Disallow | /img/forums/ |
Disallow | /articles/email.php |
Disallow | /articles/index.php |
Disallow | /news/archive.php |
Disallow | /news/search.php |
Disallow | /plugins/feedback.php |
Disallow | /misc/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.hardwarezone.com.sg/Sitemap.xml |