cside.com
robots.txt

Robots Exclusion Standard data for cside.com

Resource Scan

Scan Details

Site Domain cside.com
Base Domain cside.com
Scan Status Ok
Last Scan2025-11-28T18:14:00+00:00
Next Scan 2025-12-28T18:14:00+00:00

Last Scan

Scanned2025-11-28T18:14:00+00:00
URL https://cside.com/robots.txt
Domain IPs 104.26.4.50, 104.26.5.50, 172.67.68.226, 2606:4700:20::681a:432, 2606:4700:20::681a:532, 2606:4700:20::ac43:44e2
Response IP 104.26.4.50
Found Yes
Hash a3058c8cd061ca488bbba75bfbb5e2585ccf688beb1965a53b9833e50c18e0a7
SimHash 72329ce75425

Groups

*

Rule Path
Allow /
Allow *.jpg
Allow *.jpeg
Allow *.png
Allow *.gif
Allow *.webp
Allow *.svg
Allow *.ico
Allow /images/
Allow /assets/
Allow /favicon*
Allow /_astro/
Allow /book-demo*
Disallow /thank-you/
Disallow /search-index.json
Disallow /_worker.js/
Disallow /landing/
Allow /blog/
Allow /glossary/
Allow /compare/
Allow /pricing
Allow /about
Allow /contact
Allow /security
Allow /partners
Allow /domains
Allow /learning/
Allow /press/
Allow /news
Allow /careers
Allow /changelog
Allow /faq/
Allow /solutions/
Allow /solutions/client-side-security
Allow /solutions/pci-shield
Allow /solutions/privacy-watch
Allow /solutions/chargeback-evidence
Allow /solutions/applicant-check
Allow /solutions/gatekeeper
Allow /solutions/csp
Allow /solutions/compliance/
Allow /solutions/compliance/pci-dss
Allow /industry/
Allow /industry/crypto
Allow /industry/ecommerce
Allow /industry/gaming
Allow /industry/healthcare
Allow /industry/payments
Allow /industry/saas
Allow /use-cases/
Allow /use-cases/script-injections
Allow /use-cases/magecart
Allow /use-cases/data-leaks
Allow /use-cases/enforce-privacy
Allow /use-cases/compliance/
Allow /use-cases/compliance/pci-dss
Allow /use-cases/compliance/gdpr
Allow /use-cases/compliance/hipaa
Allow /use-cases/compliance/sox
Allow /use-cases/compliance/dora
Allow /use-cases/compliance/ccpa-cpra
Allow /use-cases/compliance/iso27001
Allow /compliance/
Allow /compliance/pci-dss
Allow /compliance/gdpr
Allow /compliance/hipaa
Allow /compliance/sox
Allow /compliance/dora
Allow /compliance/ccpa-cpra
Allow /compliance/iso27001

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://cside.com/sitemap-index.xml
sitemap https://cside.com/blog/rss.xml
sitemap https://cside.com/learning/rss.xml

Comments

  • Robots.txt for cside.com - Client-Side Security Platform
  • Updated: 2025
  • Allow all crawlers access to the site
  • Explicitly allow image crawling
  • Allow Astro build assets
  • Allow book-demo pages
  • Disallow crawling of private/internal pages
  • Disallow competitor landing pages (used for ads)
  • Allow important pages explicitly
  • Solutions pages
  • Industry pages
  • Use cases pages
  • Compliance pages (alternate routes)
  • Crawl delay (optional - be respectful)
  • Sitemaps