crowdstrike.com
robots.txt

Robots Exclusion Standard data for crowdstrike.com

Resource Scan

Scan Details

Site Domain crowdstrike.com
Base Domain crowdstrike.com
Scan Status Ok
Last Scan2025-10-26T22:07:30+00:00
Next Scan 2025-11-09T22:07:30+00:00

Last Scan

Scanned2025-10-26T22:07:30+00:00
URL https://crowdstrike.com/robots.txt
Redirect https://www.crowdstrike.com/robots.txt
Redirect Domain www.crowdstrike.com
Redirect Base crowdstrike.com
Domain IPs 104.16.180.118, 104.16.181.118, 2606:4700::6810:b476, 2606:4700::6810:b576
Redirect IPs 104.16.180.118, 104.16.181.118, 2606:4700::6810:b476, 2606:4700::6810:b576
Response IP 104.16.180.118
Found Yes
Hash cddfd843f0d2606952ac1b5039c22a825d235827f0f0c277bca7bb3e724d5c14
SimHash c911b0cd7912

Groups

*

Rule Path
Disallow /*?*
Allow /en-us/login/
Disallow /en-us/login/*
Disallow /en-us/blog/category*
Disallow /channel-file-291-rca-executive-summary-es/
Disallow /preliminary-post-incident-review-es/
Disallow /statement-from-crowdstrike-chief-security-officer-shawn-henry-es/
Disallow /statement-on-falcon-content-update-for-windows-hosts-es/
Disallow /technical-details-on-todays-outage-es/
Disallow /channel-file-291-rca-executive-summary-latam/
Disallow /preliminary-post-incident-review-latam/
Disallow /statement-from-crowdstrike-chief-security-officer-shawn-henry-latam/
Disallow /statement-on-falcon-content-update-for-windows-hosts-latam/
Disallow /technical-details-on-todays-outage-latam/
Disallow /channel-file-291-rca-executive-summary-it/
Disallow /preliminary-post-incident-review-it/
Disallow /statement-from-crowdstrike-chief-security-officer-shawn-henry-it/
Disallow /statement-on-falcon-content-update-for-windows-hosts-it/
Disallow /technical-details-on-todays-outage-it/
Disallow /preliminary-post-incident-review-kr/
Disallow /statement-from-crowdstrike-chief-security-officer-shawn-henry-kr/
Disallow /statement-on-falcon-content-update-for-windows-hosts-kr/
Disallow /technical-details-on-todays-outage-kr/
Disallow /preliminary-post-incident-review-tw/
Disallow /statement-from-crowdstrike-chief-security-officer-shawn-henry-tw/
Disallow /statement-on-falcon-content-update-for-windows-hosts-tw/
Disallow /technical-details-on-todays-outage-tw/
Disallow /falcon-content-update-remediation-and-guidance-hub/translated-resources/
Disallow /statement-on-falcon-content-update-for-windows-hosts-ar/

Other Records

Field Value
sitemap https://www.crowdstrike.com/sitemap_index.xml
sitemap https://www.crowdstrike.com/blog/sitemap_index.xml
sitemap https://www.crowdstrike.com/falcon-sitemap.xml