Log In Sign Up

shop.theclub.com.hk
robots.txt

Robots Exclusion Standard data for shop.theclub.com.hk

Resource Scan

Scan Details

Site Domain shop.theclub.com.hk
Base Domain theclub.com.hk
Scan Status Ok
Last Scan2024-05-03T11:31:30+00:00
Next Scan 2024-05-17T11:31:30+00:00

Last Scan

Scanned2024-05-03T11:31:30+00:00
URL https://shop.theclub.com.hk/robots.txt
Domain IPs 108.157.254.124, 108.157.254.28, 108.157.254.69, 108.157.254.95
Response IP 108.157.254.69
Found Yes
Hash 3ea9fd57cf1f9b31b7153ffc57d546e39afa6023289656e6a4abb39c9bfaed59
SimHash 71559f177b82

Groups

*

Rule Path
Allow /en/
Allow /zh/
Disallow /preprod
Disallow /t0/
Disallow /r0/
Disallow /staff-sale?.html
Disallow /checkout/*
Disallow /customer/account/
Disallow /sales/order/history/
Disallow /wishlist/
Disallow /customer/address/
Disallow /review/customer/
Disallow /newsletter/manage/
Disallow /customer/subscriptions
Disallow /cashvouchers/customer/manage/
Disallow /opppayment/customer/cards/
Disallow /catalogsearch/result/*
Disallow /promotions/staff-sales.html
Back to top

Other Records

Field Value
sitemap https://shop.theclub.com.hk/media/sitemap/sitemap_zh.xml
sitemap https://shop.theclub.com.hk/media/sitemap/sitemap_zh-3-2.xml
sitemap https://shop.theclub.com.hk/media/sitemap/sitemap_en.xml
sitemap https://shop.theclub.com.hk/media/sitemap/sitemap_en-1-2.xml
Back to top

Comments

  • Any search crawler can crawl our site
  • Allow only below mentioned paths
  • Crawl all sitemaps mentioned below
  • Disallow
  • Disable staff-sales to be searchable
Back to top

Warnings

  • 1 invalid line.
Back to top