central.co.th
robots.txt

Robots Exclusion Standard data for central.co.th

Resource Scan

Scan Details

Site Domain central.co.th
Base Domain central.co.th
Scan Status Ok
Last Scan2024-09-24T09:15:52+00:00
Next Scan 2024-10-08T09:15:52+00:00

Last Scan

Scanned2024-09-24T09:15:52+00:00
URL https://central.co.th/robots.txt
Redirect https://www.central.co.th/robots.txt
Redirect Domain www.central.co.th
Redirect Base central.co.th
Domain IPs 13.251.31.235
Redirect IPs 151.101.131.10, 151.101.195.10, 151.101.3.10, 151.101.67.10
Response IP 199.232.47.10
Found Yes
Hash 86a6a874f68f5b6502ff0b94140969c88d918bed60699d17ecae4b33c8f23518
SimHash e130e831c771

Groups

*

Rule Path
Disallow /admin
Disallow /th/user
Disallow /en/user
Disallow /th/account/
Disallow /en/account/
Disallow /en/cart
Disallow /th/cart
Disallow /en/checkout
Disallow /th/checkout
Disallow /th/search/
Disallow /en/search/
Disallow */*.html.h*
Disallow /content/cds/th/
Disallow /*.html$

Comments

  • www.robotstxt.org/
  • Allow crawling of all content...