login.gearbest.com
robots.txt

Robots Exclusion Standard data for login.gearbest.com

Resource Scan

Scan Details

Site Domain login.gearbest.com
Base Domain gearbest.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-20T13:47:36+00:00
Next Scan 2024-07-19T13:47:36+00:00

Last Successful Scan

Scanned2022-12-19T17:32:22+00:00
URL https://login.gearbest.com/robots.txt
Domain IPs 13.33.33.112, 13.33.33.114, 13.33.33.120, 13.33.33.92
Response IP 13.33.33.92
Found Yes
Hash 71ecf289a2f28939bce1f7c4832e5434b4c089a503fe0a79ac33d8ca5ffc6a41
SimHash 6659d2153734

Groups

*

Rule Path
Disallow /*?odr=
Disallow /*__*
Disallow /*?page_size=
Disallow /*?display=
Disallow /*price_range*
Disallow /*?page=
Disallow /*?qid=
Disallow /shipping/pp_*.html?act=get_shipping_info&id=*
Disallow /m-flow-a-link_buy-goods_id-*.html
Disallow /*/pp_*.html?currency=*%3Fwid=21&act=get_promo_left
Disallow /m-users-a-add_share_link-goods_id-*.html
Disallow /m-public-a-getNav-is_index-*-type-*.html
Disallow /ru/m-public-a-getNav-is_index-*-type-*.html
Disallow /m-review_img-goods_id-*-page_size-*.htm
Disallow /*?utm_source=Youtube&utm_medium=TONGXUSHENG&utm_campaign=redacted%40example.com
Disallow /*?utm_source=youtube&utm_medium=karen&utm_campaign=redacted%40example.com
Disallow /user/push-fcm
Disallow /goods/goods-multi
Disallow /goods/goods-shipping
Disallow /goods/warehouse-goods-status
Disallow /goods/promotion
Disallow /goods/user-collect
Disallow /fun/
Disallow /goods/goods-parts
Disallow /goods/banner
Disallow /goods/shipping-country
Disallow /currency/info
Disallow /goods/user-fav
Disallow /get-dark
Disallow /goods/asny-good-info
Disallow /*brand%3D*
Disallow /shop/
Disallow /about/top-searches/
Disallow /?lkid=*
Disallow /?wcode=*
Disallow /?on_sale=*
Disallow /?on_stock=*
Disallow /?is_clear=*
Disallow /?priceRange=*
Disallow /?page_size=*

crawler4j

Rule Path
Disallow /

wespe.de spider

Rule Path
Disallow /

cimri.com spider 1.x

Rule Path
Disallow /

pricebot

Rule Path
Disallow /

rytebot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

zumibot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

intersearch.de spider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

exabot-thumbnails

Rule Path
Disallow /

speedy spider

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path
Disallow /promotion-xiaomi-note-10-global-launch-special-7772.html

mediapartners-google

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.gearbest.com/sitemap/community-index.xml
sitemap https://www.gearbest.com/sitemap/sitemap-index.xml
sitemap https://www.gearbest.com/sitemap/image-index.xml
sitemap https://www.gearbest.com/sitemap/alternate-index.xml
sitemap https://www.gearbest.com/sitemap/video-index.xml
sitemap https://www.gearbest.com/sitemap/rss-index.xml
sitemap https://www.gearbest.com/sitemap/sitemap-index.xml
sitemap https://www.gearbest.com/sitemap/image-index.xml
sitemap https://www.gearbest.com/sitemap/alternate-index.xml
sitemap https://www.gearbest.com/sitemap/rss-index.xml