Log In Sign Up

theclub.com.hk
robots.txt

Robots Exclusion Standard data for theclub.com.hk

Resource Scan

Scan Details

Site Domain theclub.com.hk
Base Domain theclub.com.hk
Scan Status Ok
Last Scan2024-09-25T12:59:10+00:00
Next Scan 2024-10-09T12:59:10+00:00

Last Scan

Scanned2024-09-25T12:59:10+00:00
URL https://theclub.com.hk/robots.txt
Redirect https://www.theclub.com.hk/robots.txt
Redirect Domain www.theclub.com.hk
Redirect Base theclub.com.hk
Domain IPs 202.164.27.154
Redirect IPs 13.35.210.32, 13.35.210.57, 13.35.210.6, 13.35.210.77, 2600:9000:2200:1e00:1c:8b5e:d4c0:93a1, 2600:9000:2200:3800:1c:8b5e:d4c0:93a1, 2600:9000:2200:3c00:1c:8b5e:d4c0:93a1, 2600:9000:2200:4600:1c:8b5e:d4c0:93a1, 2600:9000:2200:6800:1c:8b5e:d4c0:93a1, 2600:9000:2200:c00:1c:8b5e:d4c0:93a1, 2600:9000:2200:cc00:1c:8b5e:d4c0:93a1, 2600:9000:2200:da00:1c:8b5e:d4c0:93a1
Response IP 13.35.210.57
Found Yes
Hash c054bb76bc93b2744c72641e4c27470dcaf3208f6b338836ab910ede31600172
SimHash 514117d663b6

Groups

*

Rule Path
Allow /en/
Allow /zh/
Disallow /staff-sale?.html
Disallow /login.html
Disallow /my-account/*
Disallow /zh/clubtravel/travel-gpt.html
Disallow /en/clubtravel/travel-gpt.html
Back to top

Other Records

Field Value
sitemap https://www.theclub.com.hk/en.sitemap.servlet.xml
sitemap https://www.theclub.com.hk/zh.sitemap.servlet.xml
Back to top

Comments

  • Any search crawler can crawl our site
  • Allow only below mentioned paths
  • Crawl all sitemaps mentioned below
  • Disallow
  • Disallow staff offers link
  • Disallow minishop link
Back to top

Warnings

  • 5 invalid lines.
Back to top