defense.com
robots.txt
Robots Exclusion Standard data for defense.com
Resource Scan
Scan Details
| Site Domain | defense.com |
| Base Domain | defense.com |
| Scan Status | Ok |
| Last Scan | 2026-01-31T01:05:18+00:00 |
| Next Scan | 2026-03-02T01:05:18+00:00 |
Last Scan
| Scanned | 2026-01-31T01:05:18+00:00 |
| URL | https://defense.com/robots.txt |
| Redirect | https://www.defense.com/robots.txt |
| Redirect Domain | www.defense.com |
| Redirect Base | defense.com |
| Domain IPs | 104.26.0.82, 104.26.1.82, 172.67.71.55, 2606:4700:20::681a:152, 2606:4700:20::681a:52, 2606:4700:20::ac43:4737 |
| Redirect IPs | 104.26.0.82, 104.26.1.82, 172.67.71.55, 2606:4700:20::681a:152, 2606:4700:20::681a:52, 2606:4700:20::ac43:4737 |
| Response IP | 104.26.0.82 |
| Found | Yes |
| Hash | 4cd8783d2ca5a4e3d0067d2b8f97ef3f1250f92fc300ff0ef6f496df7642c300 |
| SimHash | ea084801c993 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /lp/ |
| Disallow | /thank-you |
| Disallow | /become-a-partner/thank-you |
| Disallow | /penetration-testing/thank-you |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.defense.com/sitemap.xml |