aidreamscope.com
robots.txt

Robots Exclusion Standard data for aidreamscope.com

Resource Scan

Scan Details

Site Domain aidreamscope.com
Base Domain aidreamscope.com
Scan Status Ok
Last Scan2025-11-02T03:36:04+00:00
Next Scan 2025-11-09T03:36:04+00:00

Last Scan

Scanned2025-11-02T03:36:04+00:00
URL https://aidreamscope.com/robots.txt
Domain IPs 104.21.19.7, 172.67.184.95, 2606:4700:3030::ac43:b85f, 2606:4700:3036::6815:1307
Response IP 104.21.19.7
Found Yes
Hash b9c142e2a3e4da506ca34c94011d833a27c6674bc8547bfe4fbb1c1a2accd30f
SimHash 6991fe10e9ce

Groups

*

Rule Path
Disallow /_next/
Disallow /.next/
Disallow /api/
Disallow /server/
Disallow /_error
Disallow /_debug
Disallow /*.json$
Disallow /*?*
Disallow /*%5B
Disallow /*%5D
Disallow /imgs/users/
Disallow /dashboard/
Disallow /account/
Disallow /profile/
Disallow /settings/
Disallow /mailto%3A*
Disallow /*%40*.com$
Disallow /*%40*.net$
Disallow /*%40*.org$
Disallow /cdn-cgi/
Disallow /login
Disallow /signup
Disallow /auth/
Disallow /password/

Other Records

Field Value
sitemap https://aidreamscope.com/sitemap.xml

Comments

  • Next.js 系统路径
  • 查询参数和动态路由
  • 用户相关敏感路径
  • 邮件链接
  • 认证相关路径
  • Sitemap

Warnings

  • `llm-content` is not a known field.