centcom.mil
robots.txt
Robots Exclusion Standard data for centcom.mil
Resource Scan
Scan Details
Site Domain | centcom.mil |
Base Domain | centcom.mil |
Scan Status | Ok |
Last Scan | 2024-11-16T15:26:22+00:00 |
Next Scan | 2024-12-16T15:26:22+00:00 |
Last Scan
Scanned | 2024-11-16T15:26:22+00:00 |
URL | https://www.centcom.mil/robots.txt |
Domain IPs | 23.215.7.11, 23.215.7.14, 2600:1413:b000:1b::17d7:70b, 2600:1413:b000:1b::17d7:70e |
Response IP | 184.28.235.48 |
Found | Yes |
Hash | 435e6773683d828b7bfc77f1e7a61565c2c9bfa309126a148090abf1662faa55 |
SimHash | 7b0551018f06 |
Groups
*
Rule | Path |
---|---|
Disallow | *captcha* |
Disallow | /*Print.aspx |
Disallow | /*.axd$ |
Disallow | /*.exe$ |
Disallow | /bin/ |
Disallow | /Bin/ |
Disallow | /*.bin$ |
Disallow | /*.dll$ |
Disallow | /*.ssi$ |
Disallow | /Error/ |
Disallow | /Controls/ |
Disallow | /controls/ |
Disallow | /Utility/ |
Disallow | /install/ |
Disallow | /Admin/ |
Disallow | /App_Browser/ |
Disallow | /App_Code/ |
Disallow | /App_Data/ |
Disallow | /App_GlobalResources/ |
Disallow | /Components/ |
Disallow | /Config/ |
Disallow | /Documentation/ |
Disallow | /Install/ |
Disallow | /Providers/ |
Other Records
Field | Value |
---|---|
sitemap | /DesktopModules/SiteData/SiteMap.ashx |