Log In Sign Up

continuations.com
robots.txt

Robots Exclusion Standard data for continuations.com

Resource Scan

Scan Details

Site Domain continuations.com
Base Domain continuations.com
Scan Status Ok
Last Scan2025-09-06T06:38:01+00:00
Next Scan 2025-09-20T06:38:01+00:00

Last Scan

Scanned2025-09-06T06:38:01+00:00
URL https://continuations.com/robots.txt
Redirect https://paragraph.com/robots.txt
Redirect Domain paragraph.com
Redirect Base paragraph.com
Domain IPs 76.76.21.21
Redirect IPs 66.33.60.129, 76.76.21.123
Response IP 76.76.21.93
Found Yes
Hash bfb1c930b557e932bca9d8c8673f944a87f5ab845d50a8173e0e1135e193ab36
SimHash 88dd091906e8

Groups

*

Rule Path
Disallow /%40*%40*.*$
Disallow /*welcome-to-paragraph*
Disallow /*welcome-to-papyrus*
Disallow /*embed$
Disallow /*memberships$
Disallow /api*$
Disallow /admin*
Disallow /internal*
Disallow /dashboard*
Disallow /editor*
Disallow /settings*
Disallow /setup*
Disallow /refresh*
Disallow /*preview*
Disallow /*draft*
Disallow */collectors/*
Disallow */nft/*
Back to top

Other Records

Field Value
sitemap https://paragraph.com/sitemap.xml
Back to top

Comments

  • Next.JS Crawl Budget Performance Updates
  • Block files ending in .json, _buildManifest.js, _middlewareManifest.js, _ssgManifest.js, and any other JS files
  • The asterisks allows any file name
  • The dollar sign ensures it only matches the end of an URL and not a oddly formatted url (e.g. /locations.json.html)
  • Disallow: /*.json$
  • Disallow: /*_buildManifest.js$
  • Disallow: /*_middlewareManifest.js$
  • Disallow: /*_ssgManifest.js$
  • Disallow: /*.js$
  • All posts with unconfigured (default) accounts
  • eg paragraph.com/@colin@paragraph.com
  • or a wallet address
  • All welcome posts
  • The iFrame embeds.
  • Disallow all API calls
  • eg /api/amp, /api/event
  • Disallow admin and internal pages
  • Disallow temporary and utility pages
  • Disallow collector and NFT pages
  • Performance: Block Next.js build files (uncomment if needed)
  • Disallow: /*.json$
  • Disallow: /*_buildManifest.js$
  • Disallow: /*_middlewareManifest.js$
  • Disallow: /*_ssgManifest.js$
  • Disallow: /*.js$
  • Disallow: /*.css$
Back to top