astragold.astragroups.org
robots.txt

Robots Exclusion Standard data for astragold.astragroups.org

Resource Scan

Scan Details

Site Domain astragold.astragroups.org
Base Domain astragroups.org
Scan Status Ok
Last Scan2026-04-08T23:47:51+00:00
Next Scan 2026-05-08T23:47:51+00:00

Last Scan

Scanned2026-04-08T23:47:51+00:00
URL https://astragold.astragroups.org/robots.txt
Domain IPs 104.21.36.35, 172.67.184.179, 2606:4700:3034::ac43:b8b3, 2606:4700:3036::6815:2423
Response IP 104.21.36.35
Found Yes
Hash a2fad9ae9de3e490b80eee712a5e66be0b32c51bf59faa093bcf8e6fa115c6d9
SimHash fe754954d654

Groups

*

Rule Path
Allow /

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cloudflarebrowserrenderingcrawler

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

Comments

  • As a condition of accessing this website, you agree to abide by the following
  • content signals:
  • (a) If a Content-Signal = yes, you may collect content for the corresponding
  • use.
  • (b) If a Content-Signal = no, you may not collect content for the
  • corresponding use.
  • (c) If the website operator does not include a Content-Signal for a
  • corresponding use, the website operator neither grants nor restricts
  • permission via Content-Signal with respect to the corresponding use.
  • The content signals and their meanings are:
  • search: building a search index and providing search results (e.g., returning
  • hyperlinks and short excerpts from your website's contents). Search does not
  • include providing AI-generated search summaries.
  • ai-input: inputting content into one or more AI models (e.g., retrieval
  • augmented generation, grounding, or other real-time taking of content for
  • generative AI search answers).
  • ai-train: training or fine-tuning AI models.
  • ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS RESERVATIONS OF
  • RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE 2019/790 ON COPYRIGHT
  • AND RELATED RIGHTS IN THE DIGITAL SINGLE MARKET.
  • BEGIN Cloudflare Managed content
  • END Cloudflare Managed Content

Warnings

  • `<!doctype html><html lang="en"><head><meta charset="utf-8"/><meta name="viewport" content="width=device-width, initial-scale=1"/><link rel="stylesheet" href="/_next/static/css/dae349878431f01a.css" data-precedence="next"/><link rel="stylesheet" href="/_next/static/css/fa4f7ec5227cdec6.css" data-precedence="next"/><link rel="preload" as="script" fetchpriority="low" href="/_next/static/chunks/webpack-60c858baad63a09e.js"/><script src="/_next/static/chunks/f90e53e4-fc6c2da0da3e3078.js" async=""></script><script src="/_next/static/chunks/3944-55aa1465884d7bec.js" async=""></script><script src="/_next/static/chunks/main-app-2bad1a20752bdf56.js" async=""></script><script src="/_next/static/chunks/5949-d87ecd5646fca1c5.js" async=""></script><script src="/_next/static/chunks/9017-c7d27cc437e8aab8.js" async=""></script><script src="/_next/static/chunks/3845-877ab5b6f556671f.js" async=""></script><script src="/_next/static/chunks/2332-5ce0fc989283484d.js" async=""></script><script src="/_next/static/chunks/7465-159e4f4d364ecddb.js" async=""></script><script src="/_next/static/chunks/8640-3b3993561a2f8534.js" async=""></script><script src="/_next/static/chunks/app/(home)/%5bproduct_id%5d/page-b09adb35ae79f0a9.js" async=""></script><script src="/_next/static/chunks/970-eed80e91b29d128e.js" async=""></script><script src="/_next/static/chunks/app/(products)/loading-f72f4d4edcb4b57b.js" async=""></script><script src="/_next/static/chunks/1200-33d4a080532980cd.js" async=""></script><script src="/_next/static/chunks/1432-b4e2cf3b6af25062.js" async=""></script><script src="/_next/static/chunks/517-0a64d8d580437e07.js" async=""></script><script src="/_next/static/chunks/7386-9c1757467ad7cbb2.js" async=""></script><script src="/_next/static/chunks/1737-8d4e00e7a68e99bc.js" async=""></script><script src="/_next/static/chunks/5140-936c8879f76b13a7.js" async=""></script><script src="/_next/static/chunks/4645-5460238bda267006.js" async=""></script><script src="/_next/static/chunks/1161-21b7d46fe8fadc5e.js" async=""></script><script src="/_next/static/chunks/7115-c2a89ce455ca69dd.js" async=""></script><script src="/_next/static/chunks/app/layout-df6f74958812f7e2.js" async=""></script><meta name="next-size-adjust" content=""/><title>astra gold</title><meta name="description" content="astra gold"/><link rel="manifest" href="/manifest.json"/><link rel="icon" href="/favicon.ico" type="image/x-icon" sizes="16x16"/><script src="/_next/static/chunks/polyfills-42372ed130431b0a.js" nomodule=""></script></head><body class="__variable_9b9fd1 __variable_9a8899 font-sans antialiased"><div hidden=""><!--$--><!--/$--></div><div class="fixed inset-0 -z-10" style="background-image` is not a known field.
  • `content-signal` is not a known field.