exporthub.cn
robots.txt

Robots Exclusion Standard data for exporthub.cn

Resource Scan

Scan Details

Site Domain exporthub.cn
Base Domain exporthub.cn
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-31T02:17:23+00:00
Next Scan 2024-11-29T02:17:23+00:00

Last Successful Scan

Scanned2024-05-04T02:14:16+00:00
URL https://exporthub.cn/robots.txt
Redirect https://www.exporthub.cn/robots.txt
Redirect Domain www.exporthub.cn
Redirect Base exporthub.cn
Domain IPs 104.21.30.183, 172.67.173.131, 2606:4700:3032::ac43:ad83, 2606:4700:3033::6815:1eb7
Redirect IPs 104.21.30.183, 172.67.173.131, 2606:4700:3032::ac43:ad83, 2606:4700:3033::6815:1eb7
Response IP 172.67.173.131
Found Yes
Hash 89232ebcd624bd13b105059fe3288c0f5a76d6511ae4139535fda5257f050198
SimHash 0b5119b7c316

Groups

baiduspider

Rule Path
Allow /
Allow /-manufacturers/
Allow /importers/
Allow /product/
Disallow /eh-*
Disallow /prod/*
Disallow /latest/
Disallow /suppliers/*
Disallow /trade-lead/*

sogou

Rule Path
Allow /
Allow /-manufacturers/
Allow /importers/
Allow /product/
Disallow /eh-*
Disallow /prod/*
Disallow /latest/
Disallow /suppliers/*
Disallow /trade-lead/*

haosouspider

Rule Path
Allow /
Allow /-manufacturers/
Allow /importers/
Allow /product/
Disallow /eh-*
Disallow /prod/*
Disallow /latest/
Disallow /suppliers/*
Disallow /trade-lead/*

jikespider

Rule Path
Allow /
Allow /-manufacturers/
Allow /importers/
Allow /product/
Disallow /eh-*
Disallow /prod/*
Disallow /latest/
Disallow /suppliers/*
Disallow /trade-lead/*

sosospider

Rule Path
Allow /
Allow /-manufacturers/
Allow /importers/
Allow /product/
Disallow /eh-*
Disallow /prod/*
Disallow /latest/
Disallow /suppliers/*
Disallow /trade-lead/*

shenma

Rule Path
Allow /
Allow /-manufacturers/
Allow /importers/
Allow /product/
Disallow /eh-*
Disallow /prod/*
Disallow /latest/
Disallow /suppliers/*
Disallow /trade-lead/*

googlebot

Rule Path
Allow /
Allow /-manufacturers/
Allow /importers/
Allow /product/
Disallow /eh-*
Disallow /prod/*
Disallow /latest/
Disallow /suppliers/*
Disallow /trade-lead/*

duckduckgo

Rule Path
Allow /
Allow /-manufacturers/
Allow /importers/
Allow /product/
Disallow /eh-*
Disallow /prod/*
Disallow /latest/
Disallow /suppliers/*
Disallow /trade-lead/*

slurp

Rule Path
Allow /
Allow /-manufacturers/
Allow /importers/
Allow /product/
Disallow /eh-*
Disallow /prod/*
Disallow /latest/
Disallow /suppliers/*
Disallow /trade-lead/*

yandexbot

Rule Path
Allow /
Allow /-manufacturers/
Allow /importers/
Allow /product/
Disallow /eh-*
Disallow /prod/*
Disallow /latest/
Disallow /suppliers/*
Disallow /trade-lead/*

bingbot

Rule Path
Allow /
Allow /-manufacturers/
Allow /importers/
Allow /product/
Disallow /eh-*
Disallow /prod/*
Disallow /latest/
Disallow /suppliers/*
Disallow /trade-lead/*

msnbot

Rule Path
Allow /
Allow /-manufacturers/
Allow /importers/
Allow /product/
Disallow /eh-*
Disallow /prod/*
Disallow /latest/
Disallow /suppliers/*
Disallow /trade-lead/*

aolbuild

Rule Path
Allow /
Allow /-manufacturers/
Allow /importers/
Allow /product/
Disallow /eh-*
Disallow /prod/*
Disallow /latest/
Disallow /suppliers/*
Disallow /trade-lead/*

teoma

Rule Path
Allow /
Allow /-manufacturers/
Allow /importers/
Allow /product/
Disallow /eh-*
Disallow /prod/*
Disallow /latest/
Disallow /suppliers/*
Disallow /trade-lead/*

baiduspider-image

Rule Path
Allow /

baiduspider-video

Rule Path
Allow /

baiduspider-news

Rule Path
Allow /

baiduspider-favo

Rule Path
Allow /

baiduspider-ads

Rule Path
Allow /

baiduspider-cpro

Rule Path
Allow /

baiduspider-mobile

Rule Path
Allow /

sogou web spider

Rule Path
Allow /

sogou web spider

Rule Path
Allow /

sogou inst spider

Rule Path
Allow /

sogou spider2

Rule Path
Allow /

sogou blog

Rule Path
Allow /

sogou news spider

Rule Path
Allow /

sogou orion spider

Rule Path
Allow /

sogou web spider/4.0

Rule Path
Allow /

yandexmobilebo

Rule Path
Allow /

yandex

Rule Path
Allow /

yandexdirect

Rule Path
Allow /

yandexdirectdyn

Rule Path
Allow /

yandexmedia

Rule Path
Allow /

yandeximages

Rule Path
Allow /

yandexblogs

Rule Path
Allow /

yandexnews

Rule Path
Allow /

yandexpagechecker

Rule Path
Allow /

yandexmetrika

Rule Path
Allow /

yandexscreenshotbot

Rule Path
Allow /

yandexfavicons

Rule Path
Allow /

yandexwebmaster

Rule Path
Allow /

yandeximageresizer

Rule Path
Allow /

yandexsitelinks

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.exporthub.cn/all_sitemap_cn.xml

Warnings

  • 10 invalid lines.