globalsources.com.hk
robots.txt

Robots Exclusion Standard data for globalsources.com.hk

Resource Scan

Scan Details

Site Domain globalsources.com.hk
Base Domain globalsources.com.hk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-02T22:10:05+00:00
Next Scan 2024-12-01T22:10:05+00:00

Last Successful Scan

Scanned2023-10-14T20:10:57+00:00
URL https://globalsources.com.hk/robots.txt
Redirect https://www.globalsources.com:443/robots.txt
Redirect Domain www.globalsources.com
Redirect Base globalsources.com
Domain IPs 18.167.128.221, 18.167.144.50
Redirect IPs 107.154.197.39
Response IP 107.154.197.39
Found Yes
Hash b88843b4cd45117dfae95f1f9cc36d5854f25ef446578b749702d63327ba30f2
SimHash 61c212e3d7b0

Groups

*

Rule Path
Disallow *%7B*
Disallow *.do?*
Disallow *undefine*
Disallow *productDetail*
Disallow /sensors/
Disallow /si/
Disallow /gsol/
Disallow /_nuxt/
Disallow /fonts/

adsbot-google
adsbot-google-mobile

Rule Path
Disallow /sensors/
Disallow /si/
Disallow /gsol/
Disallow /product/
Disallow /_nuxt/
Disallow /products/
Disallow /wholesale/
Disallow /factory/
Disallow /TMX/
Disallow /fonts/
Allow /product/landingPage/

yahooseeker

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

voyager

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Warnings

  • 2 invalid lines.