Log In Sign Up

chinaanfu.com
robots.txt

Robots Exclusion Standard data for chinaanfu.com

Resource Scan

Scan Details

Site Domain chinaanfu.com
Base Domain chinaanfu.com
Scan Status Ok
Last Scan2025-11-10T00:56:49+00:00
Next Scan 2025-12-10T00:56:49+00:00

Last Scan

Scanned2025-11-10T00:56:49+00:00
URL https://chinaanfu.com/robots.txt
Redirect https://www.chinaanfu.com/robots.txt
Redirect Domain www.chinaanfu.com
Redirect Base chinaanfu.com
Domain IPs 104.21.73.102, 172.67.189.164, 2606:4700:3032::ac43:bda4, 2606:4700:3037::6815:4966
Redirect IPs 104.21.73.102, 172.67.189.164, 2606:4700:3032::ac43:bda4, 2606:4700:3037::6815:4966
Response IP 104.21.73.102
Found Yes
Hash 59f324cc70530fff204492cbba6e7b5f5e872bf05c4735bddd85f24005bf2084
SimHash 12de5903c650

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-render

Rule Path
Allow /

bingbot

Rule Path
Allow /

bingbot-render

Rule Path
Allow /

bytespider

Rule Path
Allow /

baiduspider

Rule Path
Allow /

baiduspider-html5

Rule Path
Allow /

baiduspider-mobile

Rule Path
Allow /

baiduspider-render

Rule Path
Allow /

sogou spider

Rule Path
Allow /

sogou spider-render

Rule Path
Allow /

yisouspider

Rule Path
Allow /

yandexbot

Rule Path
Allow /

petalbot

Rule Path
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

oai-imagebot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-searchbot

Rule Path
Disallow /

claude-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

google-cloudvertexbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

perplexity-user

Rule Path
Disallow /

mistralai-user

Rule Path
Disallow /

stabilityai

Rule Path
Disallow /

novellum ai crawl

Rule Path
Disallow /

proratainc

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

anchor browser

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

phindbot

Rule Path
Disallow /

cohereai

Rule Path
Disallow /

jina ai

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

spbot

Rule Path
Disallow /

cocolyzebot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

nutch

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

curl

Rule Path
Disallow /

wget

Rule Path
Disallow /

httpclient

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top

Comments

  • å
  • =========================
  • 正规搜索引擎å
  • =========================
  • Google
  • Bing / å¿
  • 今日头条
  • 百度
  • 搜狗
  • 360
  • 神马搜索
  • Yandex
  • Petal
  • 屏蔽所有 AI 训练爬虫 & 恶意SEO采集器
  • 恶意SEO采集器 & 黑帽爬虫
  • å
Back to top

Warnings

  • 10 invalid lines.
Back to top