globalsecurity.org
robots.txt
Robots Exclusion Standard data for globalsecurity.org
Resource Scan
Scan Details
| Site Domain | globalsecurity.org |
| Base Domain | globalsecurity.org |
| Scan Status | Ok |
| Last Scan | 2024-11-08T12:02:05+00:00 |
| Next Scan | 2024-11-15T12:02:05+00:00 |
Last Scan
| Scanned | 2024-11-08T12:02:05+00:00 |
| URL | https://globalsecurity.org/robots.txt |
| Redirect | https://www.globalsecurity.org:443/robots.txt |
| Redirect Domain | www.globalsecurity.org |
| Redirect Base | globalsecurity.org |
| Domain IPs | 13.68.95.120 |
| Redirect IPs | 13.68.95.120 |
| Response IP | 13.68.95.120 |
| Found | Yes |
| Hash | 592bd55ec2ae17027a880963797fa89aa76a192fbb32709bc5bc29842047804c |
| SimHash | 4076dbd23393 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /phpadsnew/ |
| Disallow | /cgi-bin/texis.cgi/webinator/search/ |
| Allow | / |
googlebot
| Rule | Path |
|---|---|
| Disallow | /intell/library/news/ |
| Disallow | /military/library/news/ |
| Disallow | /security/library/news/ |
| Disallow | /space/library/news/ |
| Disallow | /wmd/library/news/ |
| Disallow | /auto/ |
| Disallow | /books/ |
| Disallow | /conferences/ |
| Disallow | /flvplayer/ |
| Disallow | /education/ |
| Disallow | /gifts/ |
| Disallow | /Library/ |
| Disallow | /loans/ |
| Disallow | /search/ |
| Disallow | /sponsor/ |
| Disallow | /stitial/ |
| Disallow | /travel/ |
| Disallow | /_inc/frames/ |