faceage.io
robots.txt

Robots Exclusion Standard data for faceage.io

Resource Scan

Scan Details

Site Domain faceage.io
Base Domain faceage.io
Scan Status Ok
Last Scan2026-03-27T00:49:28+00:00
Next Scan 2026-04-03T00:49:28+00:00

Last Scan

Scanned2026-03-27T00:49:28+00:00
URL https://faceage.io/robots.txt
Domain IPs 104.21.5.193, 172.67.154.174, 2606:4700:3034::6815:5c1, 2606:4700:3036::ac43:9aae
Response IP 172.67.154.174
Found Yes
Hash bffc479bee4e32b3578bfe92b0569f2981c074df8a28d723bac4d1ceb352c219
SimHash 6b1cd804c455

Groups

oai-searchbot
chatgpt-user
perplexitybot
firecrawlagent
andibot
exabot
phindbot
youbot

Rule Path
Allow /

gptbot
ccbot
google-extended

Rule Path
Disallow /*?*q=
Disallow /privacy-policy
Disallow /terms-of-service

googlebot
bingbot

Rule Path
Allow /

*

Rule Path
Disallow /admin/

Other Records

Field Value
sitemap https://faceage.io/sitemap.xml

Comments

  • 允许 AI 搜索引擎访问
  • 禁止 AI 训练数据爬取
  • 允许传统搜索引擎索引
  • 阻止所有爬虫访问后台管理页面