hardwarezone.com
robots.txt

Robots Exclusion Standard data for hardwarezone.com

Resource Scan

Scan Details

Site Domain hardwarezone.com
Base Domain hardwarezone.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-06T11:45:26+00:00
Next Scan 2025-02-04T11:45:26+00:00

Last Successful Scan

Scanned2024-07-10T11:36:22+00:00
URL https://hardwarezone.com/robots.txt
Redirect https://www.hardwarezone.com.sg/robots.txt
Redirect Domain www.hardwarezone.com.sg
Redirect Base hardwarezone.com.sg
Domain IPs 108.156.133.115, 108.156.133.66, 108.156.133.8, 108.156.133.90
Redirect IPs 152.195.221.44
Response IP 152.195.221.44
Found Yes
Hash 8825c13e6ce9d28c5b40b13326b97acacb02063b2da39d80d9c2f9dc9b1bdc85
SimHash 2b101a42a403

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /pages/mobile_home/
Disallow /videos/mobile_index/
Disallow /search/
Disallow /product-guide/0/
Disallow /product-guide/0-/
Disallow /product-guide/Array/
Disallow /product-guide/s/
Disallow /price-guide/0/
Disallow /price-guide/0-/
Disallow /price-guide/Array/
Disallow /price-guide/s/
Disallow /techshow-portal/
Disallow /marketplace/edit/
Disallow /marketplace/list_open
Disallow /marketplace/list_closed
Disallow /webroot/index.php
Disallow /product-guide/list/list/
Disallow /price-guide/list/list/
Disallow /blogs/tagged/0-/
Disallow /product-guide/all/reviews/tagged/0-/
Disallow /product-guide/all/reviews/tagged/0/
Disallow /product-guide/all/tagged/0-/
Disallow /product-guide/all/tagged/13-/
Disallow /product-guide/reviews/Array/
Disallow /product-guide/13/
Disallow /product-guide/17/
Disallow /product-guide/18/
Disallow /product-guide/19/
Disallow /product-guide/153/
Disallow /product-guide/234/
Disallow /product-guide/400/
Disallow /products/listing/cat%3AArray/
Disallow /img/forums/
Disallow /articles/email.php
Disallow /articles/index.php
Disallow /news/archive.php
Disallow /news/search.php
Disallow /plugins/feedback.php
Disallow /misc/

Other Records

Field Value
crawl-delay 10

ia_archiver

Rule Path
Disallow /marketplace/

ccbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.hardwarezone.com.sg/Sitemap.xml