Log In Sign Up

douweike.com
robots.txt

Robots Exclusion Standard data for douweike.com

Resource Scan

Scan Details

Site Domain douweike.com
Base Domain douweike.com
Scan Status Ok
Last Scan2026-02-24T00:03:11+00:00
Next Scan 2026-03-26T00:03:11+00:00

Last Scan

Scanned2026-02-24T00:03:11+00:00
URL https://douweike.com/robots.txt
Redirect https://www.douweike.com/robots.txt
Redirect Domain www.douweike.com
Redirect Base douweike.com
Domain IPs 103.145.106.234, 103.145.106.252, 103.145.106.63, 155.117.148.177, 156.245.232.175, 207.56.13.178, 207.56.16.26
Redirect IPs 103.145.106.234, 103.145.106.252, 103.145.106.63, 155.117.148.177, 156.245.232.175, 207.56.13.178, 207.56.16.26
Response IP 103.145.106.234
Found Yes
Hash f89c54367be0b3e865ea8cc5a6d4c0a2c49709570c95307dcd9d510e2fd74a9b
SimHash 1a9ec3825651

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-render

Rule Path
Allow /

bingbot

Rule Path
Allow /

bingbot-render

Rule Path
Allow /

bytespider

Rule Path
Allow /

baiduspider

Rule Path
Allow /

baiduspider-html5

Rule Path
Allow /

baiduspider-mobile

Rule Path
Allow /

baiduspider-render

Rule Path
Allow /

sogou spider

Rule Path
Allow /

sogou spider-render

Rule Path
Allow /

yisouspider

Rule Path
Allow /

yandexbot

Rule Path
Allow /

petalbot

Rule Path
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

oai-imagebot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-searchbot

Rule Path
Disallow /

claude-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

google-cloudvertexbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap http://www.douweike.com/sitemap.xml
Back to top

Comments

  • =========================
  • 主流搜索引擎允许抓取 + AI 禁止规则
  • =========================
  • 网站地图
  • Google
  • Bing
  • 今日头条
  • 百度
  • 搜狗
  • 360
  • 神马
  • Yandex
  • Petal
  • AI 禁止
  • 恶意采集器禁止
  • 默认允许所有普通蜘蛛
Back to top

Warnings

  • 4 invalid lines.
Back to top