snyk.com
robots.txt

Robots Exclusion Standard data for snyk.com

Resource Scan

Scan Details

Site Domain snyk.com
Base Domain snyk.com
Scan Status Ok
Last Scan2025-11-22T12:45:08+00:00
Next Scan 2025-12-06T12:45:08+00:00

Last Scan

Scanned2025-11-22T12:45:08+00:00
URL https://snyk.com/robots.txt
Redirect https://snyk.io/robots.txt
Redirect Domain snyk.io
Redirect Base snyk.io
Domain IPs 198.54.125.57
Redirect IPs 104.69.38.39, 2600:1413:a000:689::ecd, 2600:1413:a000:69d::ecd
Response IP 104.69.38.39
Found Yes
Hash 6b769a2af029556f945c7adf829ebfa135f4db6a5c3f6b96d48ce4083a5f54f6
SimHash 6b109872cf3f

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /*.json$
Disallow /*_buildManifest.js$
Disallow /*_middlewareManifest.js$
Disallow /*_ssgManifest.js$
Disallow /*.js$

*

Rule Path
Disallow /advisor/npm-package/

*

Rule Path
Disallow /advisor/python/

Other Records

Field Value
sitemap https://snyk.io/sitemap-index.xml
sitemap https://snyk.io/sitemaps/sitemap-pages.xml
sitemap https://snyk.io/sitemaps/sitemap-articles.xml
sitemap https://snyk.io/sitemaps/sitemap-blogs.xml
sitemap https://snyk.io/sitemaps/sitemap-case-studies.xml
sitemap https://snyk.io/sitemaps/sitemap-contributors.xml
sitemap https://snyk.io/sitemaps/sitemap-events.xml
sitemap https://snyk.io/sitemaps/sitemap-podcasts.xml
sitemap https://snyk.io/sitemaps/sitemap-policies.xml
sitemap https://snyk.io/sitemaps/sitemap-press-releases.xml
sitemap https://snyk.io/sitemaps/sitemap-videos.xml
sitemap https://snyk.io/sitemaps/sitemap-misc.xml
sitemap https://snyk.io/advisor/sitemap/sitemap-index.xml

Comments

  • *
  • *
  • *
  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.