s.globalsources.com
robots.txt

Robots Exclusion Standard data for s.globalsources.com

Resource Scan

Scan Details

Site Domain s.globalsources.com
Base Domain globalsources.com
Scan Status Ok
Last Scan2024-05-22T15:17:22+00:00
Next Scan 2024-06-21T15:17:22+00:00

Last Scan

Scanned2024-05-22T15:17:22+00:00
URL https://s.globalsources.com/robots.txt
Domain IPs 23.52.40.56, 23.52.40.57
Response IP 23.52.40.11
Found Yes
Hash a747e0db4c1a7c618d99a6043fc4ca9e37677a109afa2a1a49414facc39f906f
SimHash 45d473abd336

Groups

*

Rule Path
Disallow *%7B*
Disallow /1566930/*
Disallow /cd/owa/
Disallow /cw/GeneralManager
Disallow /cw/gsol/pex/en/cwdesign1/jsp/main.jsp?section=ViewBasket
Disallow /cw/gsol/pex/en/cwdesign2/jsp/main.jsp?section=ViewBasket
Disallow /cw/gsol/pex/en/cwdesign3/jsp/main.jsp?section=ViewBasket
Disallow /cw/gsol/pex/en/cwdesign4/jsp/main.jsp?section=ViewBasket
Disallow /cw/gsol/pex/en/cwdesign5/jsp/main.jsp?section=ViewBasket
Disallow /cw/gsol/pex/en/cwdesign6/jsp/main.jsp?section=ViewBasket
Disallow /cw/gsol/pex/en/cwdesignesc/jsp/main.jsp?section=ViewBasket
Disallow /cw/gsol/pex/en/cwdesign1//jsp/main.jsp?section=ViewBasket
Disallow /cw/gsol/pex/en/cwdesign2//jsp/main.jsp?section=ViewBasket
Disallow /cw/gsol/pex/en/cwdesign3//jsp/main.jsp?section=ViewBasket
Disallow /cw/gsol/pex/en/cwdesign4//jsp/main.jsp?section=ViewBasket
Disallow /cw/gsol/pex/en/cwdesign5//jsp/main.jsp?section=ViewBasket
Disallow /cw/gsol/pex/en/cwdesign6//jsp/main.jsp?section=ViewBasket
Disallow /cw/gsol/pex/en/cwdesignesc//jsp/main.jsp?section=ViewBasket
Disallow /GeneralManager
Disallow /gsim/*
Disallow /gsol/nsl/GeneralManager
Disallow /gsol/GeneralManager
Disallow /gsol/DDL4/*
Disallow /gsol/OTSBooth/*
Disallow /gsol/TP/*
Disallow /scw/
Disallow /sn/*
Disallow /sreg/*
Disallow /sso/GeneralManager
Disallow /trdshw/GeneralManager
Disallow /trdshw/gsol/pex/en/bondat/jsp/common/visreg.jsp
Disallow /tscgi-bin/
Disallow /*GetPoint*action%3DDoFreeTextSearch*
Disallow /*page%3Dinquiry/InqForm*
Disallow *DoFreeTextSearch*ProductSearchResults*
Disallow *ProductSearchResults*DoFreeTextSearch*
Disallow *page%3Dinquiry/TokenInqForm*
Disallow */InqNow/*

yahooseeker

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

voyager

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Warnings

  • 2 invalid lines.