hardwarezone.com.sg
robots.txt

Robots Exclusion Standard data for hardwarezone.com.sg

Resource Scan

Scan Details

Site Domain hardwarezone.com.sg
Base Domain hardwarezone.com.sg
Scan Status Ok
Last Scan2024-06-04T15:46:57+00:00
Next Scan 2024-06-11T15:46:57+00:00

Last Scan

Scanned2024-06-04T15:46:57+00:00
URL https://hardwarezone.com.sg/robots.txt
Redirect https://www.hardwarezone.com.sg/robots.txt
Redirect Domain www.hardwarezone.com.sg
Redirect Base hardwarezone.com.sg
Domain IPs 108.156.133.115, 108.156.133.66, 108.156.133.8, 108.156.133.90
Redirect IPs 152.195.221.44
Response IP 152.195.221.44
Found Yes
Hash 3b106b4d1f8b92b210d5a4f90fb72fb9dcd1c0eabd93368b2318c99f7494ee11
SimHash 2b411a422463

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /pages/mobile_home/
Disallow /videos/mobile_index/
Disallow /search/
Disallow /product-guide/0/
Disallow /product-guide/0-/
Disallow /product-guide/Array/
Disallow /product-guide/s/
Disallow /price-guide/0/
Disallow /price-guide/0-/
Disallow /price-guide/Array/
Disallow /price-guide/s/
Disallow /techshow-portal/
Disallow /marketplace/edit/
Disallow /marketplace/list_open
Disallow /marketplace/list_closed
Disallow /webroot/index.php
Disallow /product-guide/list/list/
Disallow /price-guide/list/list/
Disallow /blogs/tagged/0-/
Disallow /product-guide/all/reviews/tagged/0-/
Disallow /product-guide/all/reviews/tagged/0/
Disallow /product-guide/all/tagged/0-/
Disallow /product-guide/all/tagged/13-/
Disallow /product-guide/reviews/Array/
Disallow /product-guide/13/
Disallow /product-guide/17/
Disallow /product-guide/18/
Disallow /product-guide/19/
Disallow /product-guide/153/
Disallow /product-guide/234/
Disallow /product-guide/400/
Disallow /products/listing/cat%3AArray/
Disallow /img/forums/
Disallow /articles/email.php
Disallow /articles/index.php
Disallow /news/archive.php
Disallow /news/search.php
Disallow /plugins/feedback.php
Disallow /misc/

Other Records

Field Value
crawl-delay 10

ia_archiver

Rule Path
Disallow /marketplace/

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.hardwarezone.com.sg/Sitemap.xml